-- Logs begin at Thu 2021-05-27 02:45:46 UTC, end at Thu 2021-05-27 04:04:33 UTC. -- May 27 03:32:40.163993 dv-cinder-793264-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 27 03:32:40.171255 dv-cinder-793264-1-iscsi devstack@n-api.service[98159]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 27 03:32:40.174462 dv-cinder-793264-1-iscsi devstack@n-api.service[98159]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 27 03:32:40 2021] *** May 27 03:32:40.174462 dv-cinder-793264-1-iscsi devstack@n-api.service[98159]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 27 03:32:40.174462 dv-cinder-793264-1-iscsi devstack@n-api.service[98159]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 27 03:32:40.174462 dv-cinder-793264-1-iscsi devstack@n-api.service[98159]: nodename: dv-cinder-793264-1-iscsi May 27 03:32:40.174462 dv-cinder-793264-1-iscsi devstack@n-api.service[98159]: machine: x86_64 May 27 03:32:40.174462 dv-cinder-793264-1-iscsi devstack@n-api.service[98159]: clock source: unix May 27 03:32:40.174462 dv-cinder-793264-1-iscsi devstack@n-api.service[98159]: pcre jit disabled May 27 03:32:40.174462 dv-cinder-793264-1-iscsi devstack@n-api.service[98159]: detected number of CPU cores: 4 May 27 03:32:40.174462 dv-cinder-793264-1-iscsi devstack@n-api.service[98159]: current working directory: / May 27 03:32:40.174462 dv-cinder-793264-1-iscsi devstack@n-api.service[98159]: detected binary path: /usr/bin/uwsgi-core May 27 03:32:40.174462 dv-cinder-793264-1-iscsi devstack@n-api.service[98159]: your processes number limit is 47680 May 27 03:32:40.174462 dv-cinder-793264-1-iscsi devstack@n-api.service[98159]: your memory page size is 4096 bytes May 27 03:32:40.174462 dv-cinder-793264-1-iscsi devstack@n-api.service[98159]: detected max file descriptor number: 2048 May 27 03:32:40.174462 dv-cinder-793264-1-iscsi devstack@n-api.service[98159]: lock engine: pthread robust mutexes May 27 03:32:40.175237 dv-cinder-793264-1-iscsi devstack@n-api.service[98159]: thunder lock: enabled May 27 03:32:40.175237 dv-cinder-793264-1-iscsi devstack@n-api.service[98159]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 27 03:32:40.175237 dv-cinder-793264-1-iscsi devstack@n-api.service[98159]: Python version: 3.8.5 (default, Jan 27 2021, 15:41:15) [GCC 9.3.0] May 27 03:32:40.214903 dv-cinder-793264-1-iscsi devstack@n-api.service[98159]: Python main interpreter initialized at 0x55612aa659c0 May 27 03:32:40.214903 dv-cinder-793264-1-iscsi devstack@n-api.service[98159]: python threads support enabled May 27 03:32:40.214903 dv-cinder-793264-1-iscsi devstack@n-api.service[98159]: your server socket listen backlog is limited to 100 connections May 27 03:32:40.214903 dv-cinder-793264-1-iscsi devstack@n-api.service[98159]: your mercy for graceful operations on workers is 90 seconds May 27 03:32:40.215249 dv-cinder-793264-1-iscsi devstack@n-api.service[98159]: mapped 403077 bytes (393 KB) for 2 cores May 27 03:32:40.215325 dv-cinder-793264-1-iscsi devstack@n-api.service[98159]: *** Operational MODE: preforking *** May 27 03:32:40.215569 dv-cinder-793264-1-iscsi devstack@n-api.service[98159]: *** uWSGI is running in multiple interpreter mode *** May 27 03:32:40.215569 dv-cinder-793264-1-iscsi devstack@n-api.service[98159]: spawned uWSGI master process (pid: 98159) May 27 03:32:40.215767 dv-cinder-793264-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 27 03:32:40.216610 dv-cinder-793264-1-iscsi devstack@n-api.service[98159]: spawned uWSGI worker 1 (pid: 98160, cores: 1) May 27 03:32:40.216722 dv-cinder-793264-1-iscsi devstack@n-api.service[98159]: spawned uWSGI worker 2 (pid: 98161, cores: 1) May 27 03:32:40.216879 dv-cinder-793264-1-iscsi devstack@n-api.service[98159]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 27 03:32:41.807286 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 03:32:41.807286 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: from cryptography.utils import int_from_bytes May 27 03:32:41.807958 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 03:32:41.807958 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: from cryptography.utils import int_from_bytes May 27 03:32:41.809796 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 03:32:41.809796 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: from cryptography.utils import int_from_bytes May 27 03:32:41.810255 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 03:32:41.810255 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: from cryptography.utils import int_from_bytes May 27 03:32:44.416189 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 27 03:32:44.416766 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 27 03:32:44.416930 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 27 03:32:44.417289 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 27 03:32:44.417542 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 27 03:32:44.417641 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 27 03:32:44.418008 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 27 03:32:44.418090 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.418237 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.418332 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 27 03:32:44.418558 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.418660 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 27 03:32:44.418876 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.418974 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 27 03:32:44.419206 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.419304 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.419518 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.419632 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.419846 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.419946 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.420166 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.420274 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.420515 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.420622 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.420776 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.420872 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.421088 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.421179 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.421413 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-793264-1-iscsi {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.421500 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.421734 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.421831 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.422012 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.422096 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.422329 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.422421 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.422642 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.422738 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-793264-1-iscsi {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.422945 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.423036 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.423259 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.423350 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.423560 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.423657 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.423878 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.424055 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.424189 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.424501 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.424639 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.424800 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.424904 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.425105 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.425373 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.425508 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.425637 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.425788 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.425943 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.426029 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.426256 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.426393 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.426591 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.426688 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.426907 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.426999 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.427234 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.427351 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.427547 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.427652 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-793264-1-iscsi {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.427856 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.427949 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.428181 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.428272 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.430320 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.430430 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.430430 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.430591 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-793264-1-iscsi {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.430676 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.430764 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.430847 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.430930 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.431013 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.431374 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.431465 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.431544 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.431627 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.431715 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.431793 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.431875 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.431952 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.432028 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.432110 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.432198 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.432276 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.432357 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.432471 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.432562 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.432645 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.432784 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.432877 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.433107 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.433200 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.433411 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.433510 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.433716 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.433808 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.433964 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.434049 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.434270 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.434366 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.434591 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.434675 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.434912 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.435008 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.435218 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.435314 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.435469 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.435576 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.435734 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.435835 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.436027 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.436123 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.436343 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.436465 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.436672 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.436768 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.436969 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.437064 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.437224 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.437330 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.437548 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.437657 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.437848 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.437940 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.438152 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.438294 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.438455 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.438553 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.438760 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.438852 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.439064 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.439157 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.439372 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.439466 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.439687 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.439782 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.439994 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.440078 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.440303 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.440444 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.440648 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.440741 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.440956 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.441040 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.441262 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.441355 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.441572 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.441664 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.441893 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.441986 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.442196 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.442281 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.442513 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.442604 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.442826 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.442918 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.443130 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.443223 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.443434 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.443518 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.443738 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.443830 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.444055 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.444147 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.444380 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.444495 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.444704 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.444797 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.444952 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.445038 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.445250 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.445342 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.445576 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.445669 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.445895 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.445991 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.446197 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.446282 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.446507 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.446602 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.446801 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.446885 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.447094 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.447187 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.447398 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.447492 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.447703 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.447791 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.448006 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.448098 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.448309 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.448427 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.448636 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.448722 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.448938 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.449022 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.449240 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.449338 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.449543 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.449628 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.449847 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.449929 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.450160 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.450277 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.450468 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.450571 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.450768 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.450860 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.451068 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.451160 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.451370 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.451461 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.451672 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.451774 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.451989 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.452087 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.452291 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.452389 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.452617 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.452719 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.452922 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.453012 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.453224 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.453313 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.453525 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.453617 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.453837 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.453927 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.454137 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.454227 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.454441 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.454542 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.454748 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.454837 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.455041 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.455137 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.455351 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.455443 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.455656 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.455798 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.455958 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.456055 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.456262 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.456361 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.456588 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.456688 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.456889 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.456980 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.457190 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.457281 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.457491 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.457585 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.457790 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.457889 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.458087 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.458187 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.458395 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.458487 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.458682 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.458771 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.458987 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.459091 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.459290 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.459393 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.459593 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.459685 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.459891 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.459994 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.460204 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.460306 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.460547 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.460637 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.460857 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.460958 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.461701 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.461800 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.462011 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.462111 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.462335 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:32:44.462434 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.462670 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.462768 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.463006 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.463097 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.463351 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.463452 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.463660 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.463751 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.463987 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.464163 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.464329 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.464433 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.464619 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.464706 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.464929 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.465037 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.465249 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.465336 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.465568 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.465655 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.465880 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.465977 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.466196 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.466283 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.466507 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.466598 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.466824 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.466918 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.467133 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.467219 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.467450 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.467534 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.467770 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.467877 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.468088 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.468189 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.468429 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.468533 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.468736 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.468835 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.469057 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.469149 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.469385 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.469475 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.469710 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.469810 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.470021 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.470119 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.470343 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.470444 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.470655 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.470755 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.470967 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.471065 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.471277 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.471369 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.471593 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.471685 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.471906 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.472005 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.472216 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.472316 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.472556 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.472647 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.472873 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.472963 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.473187 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.473287 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.473492 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.473584 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.473796 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.473887 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.474100 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.474199 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.474410 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.474502 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.474713 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.474805 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.475034 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.475131 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.475343 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.475434 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.475652 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.475751 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.475968 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.476078 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.476277 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.476373 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.476633 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.477284 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.477549 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.477646 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.477868 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.478005 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.478169 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.478264 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.478483 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.478636 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.478791 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.478887 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.479104 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.479194 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.479415 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.479513 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.479721 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.479806 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.480037 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.480122 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.480343 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.480447 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.480673 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.480763 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.480988 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.481073 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.481295 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.481380 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.481604 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.481696 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.481915 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.482000 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.482225 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.482309 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.482535 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.482626 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.482845 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.482936 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.483158 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.483242 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.483474 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.483565 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.483788 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.483878 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.484106 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.484192 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.484437 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.484525 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.484756 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.484855 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.485060 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.485154 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.485370 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.485464 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.485674 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.485768 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.486033 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.486131 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.486278 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.486363 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.486586 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.486681 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.486889 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.486973 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.487191 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.487284 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.487495 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.487656 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.487807 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.487898 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.488100 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.488184 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.488433 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.488532 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.488737 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.488869 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.489039 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.489132 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.489344 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.489438 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.489648 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.489733 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.489970 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.490054 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.490284 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.490378 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.490591 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.490721 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.490901 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.490987 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.491208 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.491294 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.491521 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.491606 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.491834 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.491921 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.492142 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.492228 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.492510 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.492601 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.492824 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.492924 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.493148 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.493240 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.493453 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.493540 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.493763 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.493860 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.494068 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.494154 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.494378 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.494461 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.494694 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.494787 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.495000 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.495084 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.495315 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.495401 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.495623 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.495716 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.495933 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.496023 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.496243 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.496339 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.496574 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.496674 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.496887 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.496979 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.497193 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.497277 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.497498 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.497585 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.497810 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.497903 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.498124 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.498262 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.498437 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.498523 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.498746 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.498836 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.499051 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.499146 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.499363 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.499448 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.499668 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.499753 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.499977 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.500063 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.500278 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.500371 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.500612 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.500699 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.500929 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.501027 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.501235 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.501320 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.501541 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.501631 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.501851 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.501944 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.502155 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.502258 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.502451 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.502545 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.502772 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.502866 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.503084 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.503176 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.503388 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.503473 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.503691 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.503788 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.503996 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.504082 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.504319 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.504428 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.504657 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.504751 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.504962 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.505054 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.505270 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.505354 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.505578 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.505673 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.505885 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.505969 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.506197 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.506339 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.506505 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.506592 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.506812 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.506904 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.507134 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.507219 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.507445 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.507530 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.507752 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.507844 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.508085 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.508170 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.508396 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.508561 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.508725 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.508810 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.509032 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.509126 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.509354 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.509441 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.509664 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.509750 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.509976 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.510068 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.510282 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.510368 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.510585 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.510669 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.510893 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.510986 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.511206 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.511297 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.511522 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.511768 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.511853 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.512102 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.512187 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.512436 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.512525 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.512762 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.512854 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.513079 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.513328 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.513413 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.513665 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.513750 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.513986 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.514072 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.514309 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.514394 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.514618 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.514703 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.514928 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.515014 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.515231 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.515317 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.515534 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.515619 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.515847 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.515935 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.516149 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.516234 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.516490 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.516578 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.516789 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.516878 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.517094 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.517177 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.517394 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.517477 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.517698 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.517784 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.518001 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.518087 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.518305 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.518438 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.518615 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.518700 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.518917 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.519004 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.519222 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.519313 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.519522 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.519607 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.519830 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.519913 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.520145 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.520236 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.520481 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.520579 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.520785 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.520870 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.521086 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.521181 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.521410 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.521493 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.521719 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.521802 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.522024 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.522109 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.522332 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.522416 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.522645 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.522756 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.522986 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.523090 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.523290 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.523390 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.524198 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.524292 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.524528 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.524621 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.524834 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.524927 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.525139 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.525230 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.525449 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.525546 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.525757 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.525856 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.526060 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.526160 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.526381 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.526500 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.526692 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.526783 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.526998 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.527102 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.527299 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.527404 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.527605 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.527695 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.527904 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.527994 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.528217 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.528317 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.528543 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.528659 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.528844 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.528932 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.529144 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.529281 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.529451 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.529537 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.529757 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.529849 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.530059 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.530153 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.530371 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.530456 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.530679 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.530771 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.530978 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.531070 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.531287 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.531376 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.531589 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.531673 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.531890 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.531983 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.532199 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.532286 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.532531 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.532620 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.532844 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.532942 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.533148 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.533234 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.533453 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.533544 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.533754 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.533846 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.534058 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.534143 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.534360 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.534444 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.534665 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.534759 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.534967 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.535051 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.535267 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.535351 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.535568 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.535654 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.535871 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.535955 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.536171 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.536300 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.536498 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.536601 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.536810 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.536907 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.537107 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.537200 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.537410 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.537497 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.537711 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.537802 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.538033 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.538118 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.538345 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.538437 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.538652 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.538747 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.538957 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.539056 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.539853 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.539949 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.540192 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.540278 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.540530 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.540635 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.540842 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.540927 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.541156 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.541280 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.541461 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.541628 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.541776 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.541871 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.542084 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.542170 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.542395 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.542489 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.542700 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.542785 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.543003 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.543088 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.543321 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.543417 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.543627 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.543710 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.543937 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.544023 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.544244 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.544336 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.544585 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.544670 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.544912 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.544996 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.545216 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.545302 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.545524 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.545609 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.545834 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.545926 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.546142 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.546228 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.546447 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.546532 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.546755 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.546855 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.547067 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.547165 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.547373 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.547458 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.547681 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.547773 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.547989 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.548088 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.548298 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.548392 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.548625 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.548782 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.548948 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.549080 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.549242 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.549327 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.549544 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.549637 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.549856 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.549993 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.550163 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.550257 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.550472 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.550570 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.550780 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.550865 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.551082 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.551173 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.551390 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.551483 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.551693 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.551778 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.552000 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.552112 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.552316 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.552440 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.552665 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.552762 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.552982 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.553075 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.553292 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.553379 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.553632 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.553716 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.553945 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.554029 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.554259 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.554351 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.554561 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.554653 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.554969 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.555057 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.555286 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.555372 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.555606 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.555697 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.555915 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.556000 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.556510 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.556599 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.556813 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.556937 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.557126 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.557245 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.557463 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.557558 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.557756 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.557853 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.558057 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.558151 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.558360 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.558453 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.558680 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.558764 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.558981 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.559078 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.559299 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.559392 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.559652 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.559744 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.559961 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.560099 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.560294 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.560379 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.560637 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.560726 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.560961 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.561049 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.561324 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.561408 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.561646 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.561732 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.561967 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.562054 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.562289 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.562375 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.562591 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.562685 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.562903 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.562990 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.563212 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.563297 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.563534 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.563619 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.563858 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.563946 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.564167 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.564264 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.564505 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.564605 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.564811 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.564904 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.565134 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.565220 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.565455 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.565550 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.565768 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.565860 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.566086 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.566169 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.566397 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.566490 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.566724 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.566818 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.567052 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.567144 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.567370 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.567473 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.567697 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.567783 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.568005 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.568119 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.568308 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.568469 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.568640 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.568788 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.568943 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.569115 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.569248 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.569443 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.569569 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.569755 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.569871 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.570073 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.570168 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.570968 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.571059 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.571334 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.571420 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.571637 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.571826 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.571954 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.572073 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.572254 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.572340 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.572580 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.572686 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.572903 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.572996 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.573218 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.573303 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.573540 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.573626 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.573863 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.573950 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.574168 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.574252 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.574481 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.574573 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.574790 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.574874 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.575095 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.575179 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.575399 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.575485 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.575701 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.575784 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.576035 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.576118 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.576341 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.576498 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.576686 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.576772 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.576995 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.577085 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.577306 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.577399 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.577616 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.577700 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.577950 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.578042 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.578261 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.578345 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.578582 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.578666 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.578899 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.578992 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.579226 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.579316 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.579531 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.579637 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.579836 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.579923 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.580147 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.580285 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.580471 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.580560 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.580782 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.580879 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.581086 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.581180 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.581396 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.581488 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.581698 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.581783 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.582003 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.582160 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.582307 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.582392 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.582631 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.582716 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.582935 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.583029 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.583246 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.583330 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.583555 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.583646 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.583858 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.583945 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.584161 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.584247 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.584498 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.584586 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.584805 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.584891 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.585129 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.585221 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.585439 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.585531 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.585750 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.585843 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.586633 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.586729 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.586947 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.587032 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.587271 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.587357 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.587592 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.587679 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.587909 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.588007 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.588228 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.588313 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.588573 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.588675 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.588892 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.588987 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.589207 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.589292 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.589522 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.589614 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.589837 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.589931 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.590147 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.590232 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.590461 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.590549 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.590775 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.590869 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.591093 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.591178 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.591415 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.591607 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.591737 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.591938 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.592053 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.592256 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.592375 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.592601 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.592725 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.592918 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.593049 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.593240 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.593553 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.593645 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.593868 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.593955 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.594180 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.594265 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.594490 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.594577 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.594802 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.594890 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.595123 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.595206 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.595439 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.595533 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.595757 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.595850 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.596073 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.596158 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.596387 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.596516 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.596725 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.596809 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.597039 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.597125 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.597360 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.597455 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.597692 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.597779 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.598027 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.598110 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.598335 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.598423 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.598651 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.598737 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.598969 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.599056 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.599287 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.599372 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.599603 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.599688 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.599918 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.600011 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.600230 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.600315 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.600578 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.600680 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.600893 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.600988 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.601204 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.601290 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.601517 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.601610 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.601854 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.601991 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.602181 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.602268 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.602503 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.602587 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.602825 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.602912 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.603137 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.603221 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.603450 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.603534 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.603764 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.603858 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.604095 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.604280 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.604463 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.604617 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.604793 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.604950 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.605113 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.605275 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.605432 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.605598 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.605753 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.605911 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.606228 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.606312 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.606554 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.606648 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.606860 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.606946 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.607162 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.607246 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.607470 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.607569 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.607781 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.607870 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.608079 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.608164 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.608442 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.608545 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.608733 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.608819 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.609036 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.609121 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.609353 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.609452 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.609665 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.609777 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.609983 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.610193 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.610299 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.610532 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.610635 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.610852 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.610944 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.611175 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.611280 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.611499 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.611591 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.611811 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.612038 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.612139 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.612389 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.612509 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.612731 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.612817 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.613035 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.613120 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.613348 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.613444 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.613659 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.613752 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.613962 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.614061 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.614265 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.614351 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.614575 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.614660 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.614881 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.614978 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.615185 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.615272 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.615493 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.615586 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.615795 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.615889 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.616101 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.616185 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.616452 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.616540 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.616737 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.616839 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.617042 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.617128 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.617376 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.617469 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.617681 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.617814 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.617984 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.618070 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.618288 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.618375 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.618589 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.618676 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.618900 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.618984 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.619201 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.619294 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.619510 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.619597 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.619812 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.619896 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.620121 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.620207 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.620443 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.620534 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.620759 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.620856 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.621063 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.621157 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.621381 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.621550 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.621692 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.621858 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.622008 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.622160 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.622317 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.622465 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.622633 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.622779 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.622942 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.623085 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.623397 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.623483 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.623706 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.623799 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.624045 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.624142 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.624360 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.624459 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.624715 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.624907 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.625047 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.625240 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.625367 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.625561 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.625686 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.625902 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.626038 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.626243 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.626362 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.626547 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.626854 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.626946 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.627159 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.627268 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.627480 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.627567 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.627793 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.627917 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.628103 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.628190 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.628438 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.628540 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.628742 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.628829 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.629054 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.629142 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.629364 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.629452 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.629673 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.629759 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.629982 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.630069 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.630290 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.630375 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.630599 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.630693 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.630938 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.631034 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.631250 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.631362 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.631563 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.631658 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.631876 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.631963 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.632190 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.632277 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.632519 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.632623 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.632830 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.633473 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.633702 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.633796 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.634019 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.634108 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.634339 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.634424 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.634668 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.634751 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.634981 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.635066 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.635286 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.635371 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.635598 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.635689 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.635912 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.636007 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.636230 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.636371 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.636591 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.636679 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.636909 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.636997 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.637219 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.637305 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.637612 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.637704 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.637943 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.638027 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.638268 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.638356 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.638574 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.638667 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.638882 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.638968 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.639188 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.639273 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.639500 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.639595 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.639843 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.639928 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.640178 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.640263 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.640522 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.640611 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.640837 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.640936 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.641151 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.641256 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.641464 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.641559 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.641774 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.641859 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.642084 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.642169 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.642398 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.642487 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.642709 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.642795 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.643029 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.643114 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.643339 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.643435 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.643657 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.643750 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.643967 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.644060 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.644284 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.644370 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.644616 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.644702 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.644936 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.645038 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.645246 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.645359 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.645559 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.645652 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.645870 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.645965 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.646183 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.646269 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.646495 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.646578 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.646817 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.646910 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.647125 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.647210 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.647434 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.647525 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.647745 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.647838 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.648051 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.648136 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.648371 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.648585 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.649301 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.649397 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.649621 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.649706 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.649932 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.650017 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.650263 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.650349 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.650574 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.650661 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.650891 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.650977 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.651205 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.651304 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.651519 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.651605 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.651829 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.651913 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.652137 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.652223 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.652487 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.652593 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.652807 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.652902 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.653124 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.653217 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.653441 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.653534 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.653757 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.653851 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.654073 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.654159 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.654394 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.654510 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.654705 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.654799 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.655017 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.655109 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.655330 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.655423 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.655646 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.655742 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.655957 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.656042 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.656267 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.656352 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.656605 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.656692 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.656919 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.657005 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.657243 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.657328 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.657563 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.657650 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.657878 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.657963 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.658196 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.658282 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.658517 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.658607 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.658832 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.658923 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.659163 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.659260 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.659483 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.659568 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.659724 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=98161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 27 03:32:44.659810 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.660136 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.660506 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.660826 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.661175 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.661510 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:32:44.661754 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=98160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 27 03:32:44.692852 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG oslo_db.sqlalchemy.engines [None req-8916db31-0611-46bf-aad8-b1ffc5525dca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=98161) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 03:32:44.693968 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG oslo_db.sqlalchemy.engines [None req-37e6a102-3c32-4cef-924e-2ba0b5a984ab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=98160) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 03:32:44.933551 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.context [None req-8916db31-0611-46bf-aad8-b1ffc5525dca None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),62df2d79-0f3c-4e85-ac9f-a1fbcca38810(cell1) {{(pid=98161) load_cells /opt/stack/nova/nova/context.py:464}} May 27 03:32:44.934705 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.context [None req-37e6a102-3c32-4cef-924e-2ba0b5a984ab None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),62df2d79-0f3c-4e85-ac9f-a1fbcca38810(cell1) {{(pid=98160) load_cells /opt/stack/nova/nova/context.py:464}} May 27 03:32:44.937836 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG oslo_concurrency.lockutils [None req-8916db31-0611-46bf-aad8-b1ffc5525dca None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:32:44.938978 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG oslo_concurrency.lockutils [None req-37e6a102-3c32-4cef-924e-2ba0b5a984ab None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:32:44.939473 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG oslo_concurrency.lockutils [None req-8916db31-0611-46bf-aad8-b1ffc5525dca None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:32:44.940275 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG oslo_concurrency.lockutils [None req-8916db31-0611-46bf-aad8-b1ffc5525dca None None] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:32:44.940649 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG oslo_concurrency.lockutils [None req-37e6a102-3c32-4cef-924e-2ba0b5a984ab None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:32:44.941455 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG oslo_concurrency.lockutils [None req-37e6a102-3c32-4cef-924e-2ba0b5a984ab None None] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:32:44.942246 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG oslo_concurrency.lockutils [None req-8916db31-0611-46bf-aad8-b1ffc5525dca None None] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:32:44.943480 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG oslo_concurrency.lockutils [None req-37e6a102-3c32-4cef-924e-2ba0b5a984ab None None] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:32:44.963739 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG oslo_db.sqlalchemy.engines [None req-8916db31-0611-46bf-aad8-b1ffc5525dca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=98161) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 03:32:44.974376 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG oslo_db.sqlalchemy.engines [None req-37e6a102-3c32-4cef-924e-2ba0b5a984ab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=98160) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 03:32:44.976109 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG oslo_db.sqlalchemy.engines [None req-37e6a102-3c32-4cef-924e-2ba0b5a984ab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=98160) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 03:32:44.979188 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG oslo_db.sqlalchemy.engines [None req-8916db31-0611-46bf-aad8-b1ffc5525dca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=98161) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 03:32:45.004765 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG oslo_db.sqlalchemy.engines [None req-8916db31-0611-46bf-aad8-b1ffc5525dca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=98161) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 03:32:45.005774 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG oslo_db.sqlalchemy.engines [None req-37e6a102-3c32-4cef-924e-2ba0b5a984ab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=98160) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 03:32:45.511877 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: WARNING keystonemiddleware.auth_token [None req-8916db31-0611-46bf-aad8-b1ffc5525dca None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 03:32:45.518335 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: WARNING keystonemiddleware.auth_token [None req-8916db31-0611-46bf-aad8-b1ffc5525dca None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 03:32:45.548049 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: WARNING keystonemiddleware.auth_token [None req-37e6a102-3c32-4cef-924e-2ba0b5a984ab None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 03:32:45.554557 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: WARNING keystonemiddleware.auth_token [None req-37e6a102-3c32-4cef-924e-2ba0b5a984ab None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 03:32:45.744209 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: WARNING keystonemiddleware.auth_token [None req-8916db31-0611-46bf-aad8-b1ffc5525dca None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 03:32:45.749336 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: WARNING keystonemiddleware.auth_token [None req-8916db31-0611-46bf-aad8-b1ffc5525dca None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 03:32:45.754528 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55612aa659c0 pid: 98161 (default app) May 27 03:32:45.756618 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi [None req-8916db31-0611-46bf-aad8-b1ffc5525dca None None] Calling method '>' {{(pid=98161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:32:45.757729 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: INFO nova.api.openstack.requestlog [None req-8916db31-0611-46bf-aad8-b1ffc5525dca None None] 10.222.0.25 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001670 May 27 03:32:45.758683 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: [pid: 98161|app: 0|req: 1/1] 10.222.0.25 () {50 vars in 789 bytes} [Thu May 27 03:32:45 2021] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:32:45.784526 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: WARNING keystonemiddleware.auth_token [None req-37e6a102-3c32-4cef-924e-2ba0b5a984ab None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 03:32:45.790016 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: WARNING keystonemiddleware.auth_token [None req-37e6a102-3c32-4cef-924e-2ba0b5a984ab None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 03:32:45.795133 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55612aa659c0 pid: 98160 (default app) May 27 03:34:08.186921 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi [None req-8916db31-0611-46bf-aad8-b1ffc5525dca None None] Calling method '>' {{(pid=98161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:08.187921 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: INFO nova.api.openstack.requestlog [None req-8916db31-0611-46bf-aad8-b1ffc5525dca None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 May 27 03:34:08.188332 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: [pid: 98161|app: 0|req: 2/2] 10.222.0.25 () {54 vars in 930 bytes} [Thu May 27 03:34:08 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:34:08.752885 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi [None req-e17729c0-dc70-455f-aa60-87447a12a5e0 admin admin] Calling method '>' {{(pid=98160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:08.779922 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: INFO nova.api.openstack.requestlog [None req-e17729c0-dc70-455f-aa60-87447a12a5e0 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.583787 May 27 03:34:08.780844 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: [pid: 98160|app: 0|req: 1/3] 10.222.0.25 () {60 vars in 1291 bytes} [Thu May 27 03:34:08 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:34:10.929892 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi [None req-8916db31-0611-46bf-aad8-b1ffc5525dca None None] Calling method '>' {{(pid=98161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:10.931423 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: INFO nova.api.openstack.requestlog [None req-8916db31-0611-46bf-aad8-b1ffc5525dca None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001961 May 27 03:34:10.932242 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: [pid: 98161|app: 0|req: 3/4] 10.222.0.25 () {54 vars in 930 bytes} [Thu May 27 03:34:10 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:34:10.991833 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi [None req-cdec1269-40f7-4f63-b587-e1f0c764128b admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "disk": 1, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "c1"}} {{(pid=98160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:34:11.010578 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:34:11.010578 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: warnings.warn(msg) May 27 03:34:11.087527 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: INFO nova.api.openstack.requestlog [None req-cdec1269-40f7-4f63-b587-e1f0c764128b admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.148911 May 27 03:34:11.088379 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: [pid: 98160|app: 0|req: 2/5] 10.222.0.25 () {64 vars in 1282 bytes} [Thu May 27 03:34:10 2021] POST /compute/v2.1/flavors => generated 407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:34:11.430057 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi [None req-9e1bf7e5-8e36-4e6e-ad52-d9350a5a8e1f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=98161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:34:11.432512 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:34:11.432512 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: warnings.warn(msg) May 27 03:34:11.566340 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: INFO nova.api.openstack.requestlog [None req-9e1bf7e5-8e36-4e6e-ad52-d9350a5a8e1f admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.470236 May 27 03:34:11.568175 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: [pid: 98161|app: 0|req: 4/6] 10.222.0.25 () {64 vars in 1335 bytes} [Thu May 27 03:34:11 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:34:13.696024 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi [None req-cdec1269-40f7-4f63-b587-e1f0c764128b admin admin] Calling method '>' {{(pid=98160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:13.697109 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: INFO nova.api.openstack.requestlog [None req-cdec1269-40f7-4f63-b587-e1f0c764128b admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 May 27 03:34:13.697524 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: [pid: 98160|app: 0|req: 3/7] 10.222.0.25 () {54 vars in 930 bytes} [Thu May 27 03:34:13 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:34:13.807092 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi [None req-a8099d34-8f4b-4b7b-b938-901bd0195730 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "name": "ds512M", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "disk": 5, "swap": 0, "ram": 512}} {{(pid=98161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:34:13.824720 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:34:13.824720 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: warnings.warn(msg) May 27 03:34:13.928992 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: INFO nova.api.openstack.requestlog [None req-a8099d34-8f4b-4b7b-b938-901bd0195730 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.225119 May 27 03:34:13.929469 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: [pid: 98161|app: 0|req: 5/8] 10.222.0.25 () {64 vars in 1282 bytes} [Thu May 27 03:34:13 2021] POST /compute/v2.1/flavors => generated 404 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 03:34:13.941497 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi [None req-0cf2bf74-9f01-4185-91b8-5a116bc844d0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=98160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:34:13.943033 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:34:13.943033 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: warnings.warn(msg) May 27 03:34:14.039102 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: INFO nova.api.openstack.requestlog [None req-0cf2bf74-9f01-4185-91b8-5a116bc844d0 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.101303 May 27 03:34:14.040070 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: [pid: 98160|app: 0|req: 4/9] 10.222.0.25 () {64 vars in 1335 bytes} [Thu May 27 03:34:13 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:34:16.187058 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi [None req-a8099d34-8f4b-4b7b-b938-901bd0195730 admin admin] Calling method '>' {{(pid=98161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:16.188202 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: INFO nova.api.openstack.requestlog [None req-a8099d34-8f4b-4b7b-b938-901bd0195730 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001643 May 27 03:34:16.188922 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: [pid: 98161|app: 0|req: 6/10] 10.222.0.25 () {54 vars in 930 bytes} [Thu May 27 03:34:16 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:34:16.246537 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi [None req-6d57ca64-52dc-4e60-95f8-b1f699c3022a admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "id": "d2", "ram": 1024, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=98160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:34:16.361342 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: INFO nova.api.openstack.requestlog [None req-6d57ca64-52dc-4e60-95f8-b1f699c3022a admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.165986 May 27 03:34:16.368545 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: [pid: 98160|app: 0|req: 5/11] 10.222.0.25 () {64 vars in 1282 bytes} [Thu May 27 03:34:16 2021] POST /compute/v2.1/flavors => generated 404 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 03:34:16.373750 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi [None req-c3c60caf-1482-4676-9fae-832b8c44f72b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=98161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:34:16.471961 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: INFO nova.api.openstack.requestlog [None req-c3c60caf-1482-4676-9fae-832b8c44f72b admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.101822 May 27 03:34:16.477177 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: [pid: 98161|app: 0|req: 7/12] 10.222.0.25 () {64 vars in 1335 bytes} [Thu May 27 03:34:16 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:34:18.612122 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi [None req-6d57ca64-52dc-4e60-95f8-b1f699c3022a admin admin] Calling method '>' {{(pid=98160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:18.613355 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: INFO nova.api.openstack.requestlog [None req-6d57ca64-52dc-4e60-95f8-b1f699c3022a admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001730 May 27 03:34:18.614017 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: [pid: 98160|app: 0|req: 6/13] 10.222.0.25 () {54 vars in 930 bytes} [Thu May 27 03:34:18 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:34:18.674557 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi [None req-202383cd-5b7f-4655-ab35-2d7443d00cc4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "id": "d3", "name": "ds2G", "ram": 2048, "vcpus": 2}} {{(pid=98161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:34:18.782310 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: INFO nova.api.openstack.requestlog [None req-202383cd-5b7f-4655-ab35-2d7443d00cc4 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.162188 May 27 03:34:18.782919 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: [pid: 98161|app: 0|req: 8/14] 10.222.0.25 () {64 vars in 1282 bytes} [Thu May 27 03:34:18 2021] POST /compute/v2.1/flavors => generated 404 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:34:18.794612 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi [None req-4be7fa6d-518d-4ce8-b137-663148adcd66 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=98160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:34:18.889478 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: INFO nova.api.openstack.requestlog [None req-4be7fa6d-518d-4ce8-b137-663148adcd66 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.098475 May 27 03:34:18.890405 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: [pid: 98160|app: 0|req: 7/15] 10.222.0.25 () {64 vars in 1335 bytes} [Thu May 27 03:34:18 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:34:21.021812 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi [None req-202383cd-5b7f-4655-ab35-2d7443d00cc4 admin admin] Calling method '>' {{(pid=98161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:21.022808 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: INFO nova.api.openstack.requestlog [None req-202383cd-5b7f-4655-ab35-2d7443d00cc4 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 May 27 03:34:21.023205 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: [pid: 98161|app: 0|req: 9/16] 10.222.0.25 () {54 vars in 930 bytes} [Thu May 27 03:34:21 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:34:21.080598 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi [None req-fc6d83ce-f96b-4948-a84b-c69ba429a803 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 4, "disk": 20, "swap": 0, "ram": 4096, "name": "ds4G"}} {{(pid=98160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:34:21.161004 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: INFO nova.api.openstack.requestlog [None req-fc6d83ce-f96b-4948-a84b-c69ba429a803 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.132056 May 27 03:34:21.161680 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: [pid: 98160|app: 0|req: 8/17] 10.222.0.25 () {64 vars in 1282 bytes} [Thu May 27 03:34:21 2021] POST /compute/v2.1/flavors => generated 404 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:34:21.173393 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi [None req-8e0af2cd-bfac-48c8-8288-e4ab15ee5615 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=98161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:34:21.298465 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: INFO nova.api.openstack.requestlog [None req-8e0af2cd-bfac-48c8-8288-e4ab15ee5615 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.128639 May 27 03:34:21.299163 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: [pid: 98161|app: 0|req: 10/18] 10.222.0.25 () {64 vars in 1335 bytes} [Thu May 27 03:34:21 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:34:23.413595 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi [None req-fc6d83ce-f96b-4948-a84b-c69ba429a803 admin admin] Calling method '>' {{(pid=98160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:23.417655 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: INFO nova.api.openstack.requestlog [None req-fc6d83ce-f96b-4948-a84b-c69ba429a803 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.006141 May 27 03:34:23.425864 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: [pid: 98160|app: 0|req: 9/19] 10.222.0.25 () {54 vars in 930 bytes} [Thu May 27 03:34:23 2021] GET /compute/v2.1 => generated 388 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:34:23.489879 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi [None req-cc8d5168-ad6c-4560-b333-7ba3abdeb2e7 admin admin] Calling method '>' {{(pid=98161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:23.511291 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: INFO nova.api.openstack.requestlog [None req-cc8d5168-ad6c-4560-b333-7ba3abdeb2e7 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.086011 May 27 03:34:23.511849 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: [pid: 98161|app: 0|req: 11/20] 10.222.0.25 () {60 vars in 1291 bytes} [Thu May 27 03:34:23 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:34:25.632830 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi [None req-fc6d83ce-f96b-4948-a84b-c69ba429a803 admin admin] Calling method '>' {{(pid=98160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:25.633842 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: INFO nova.api.openstack.requestlog [None req-fc6d83ce-f96b-4948-a84b-c69ba429a803 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 May 27 03:34:25.634245 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: [pid: 98160|app: 0|req: 10/21] 10.222.0.25 () {54 vars in 930 bytes} [Thu May 27 03:34:25 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:34:25.694432 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi [None req-148a71ab-d26e-4382-a3ac-58fcccfc0a21 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "disk": 1, "os-flavor-access:is_public": true, "ram": 512, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "vcpus": 1, "swap": 0}} {{(pid=98161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:34:25.779201 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: INFO nova.api.openstack.requestlog [None req-148a71ab-d26e-4382-a3ac-58fcccfc0a21 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.138911 May 27 03:34:25.779751 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: [pid: 98161|app: 0|req: 12/22] 10.222.0.25 () {64 vars in 1282 bytes} [Thu May 27 03:34:25 2021] POST /compute/v2.1/flavors => generated 402 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:34:25.795312 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi [None req-ed2e9891-9d20-4811-813b-23bc2f9724ae admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=98160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:34:25.901493 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: INFO nova.api.openstack.requestlog [None req-ed2e9891-9d20-4811-813b-23bc2f9724ae admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.112508 May 27 03:34:25.902611 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: [pid: 98160|app: 0|req: 11/23] 10.222.0.25 () {64 vars in 1332 bytes} [Thu May 27 03:34:25 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:34:28.823133 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi [None req-148a71ab-d26e-4382-a3ac-58fcccfc0a21 admin admin] Calling method '>' {{(pid=98161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:28.824141 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: INFO nova.api.openstack.requestlog [None req-148a71ab-d26e-4382-a3ac-58fcccfc0a21 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 May 27 03:34:28.824848 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: [pid: 98161|app: 0|req: 13/24] 10.222.0.25 () {54 vars in 930 bytes} [Thu May 27 03:34:28 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:34:28.887364 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi [None req-96f78351-53fd-4b42-aabe-67681813b802 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.small", "vcpus": 1, "ram": 2048, "disk": 20}} {{(pid=98160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:34:28.965557 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: INFO nova.api.openstack.requestlog [None req-96f78351-53fd-4b42-aabe-67681813b802 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.134865 May 27 03:34:28.966121 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: [pid: 98160|app: 0|req: 12/25] 10.222.0.25 () {64 vars in 1282 bytes} [Thu May 27 03:34:28 2021] POST /compute/v2.1/flavors => generated 405 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 03:34:28.978132 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi [None req-dce10ba4-6239-4053-a292-eaba62662822 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=98161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:34:29.069269 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: INFO nova.api.openstack.requestlog [None req-dce10ba4-6239-4053-a292-eaba62662822 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.094708 May 27 03:34:29.070026 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: [pid: 98161|app: 0|req: 14/26] 10.222.0.25 () {64 vars in 1332 bytes} [Thu May 27 03:34:28 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:34:31.269725 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi [None req-96f78351-53fd-4b42-aabe-67681813b802 admin admin] Calling method '>' {{(pid=98160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:31.271358 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: INFO nova.api.openstack.requestlog [None req-96f78351-53fd-4b42-aabe-67681813b802 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002056 May 27 03:34:31.271780 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: [pid: 98160|app: 0|req: 13/27] 10.222.0.25 () {54 vars in 930 bytes} [Thu May 27 03:34:31 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:34:31.328031 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi [None req-730eb8f4-f661-4b3b-a1ba-5c43f4fa5bd7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 2, "name": "m1.medium", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 40, "rxtx_factor": 1.0, "id": "3"}} {{(pid=98161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:34:31.412810 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: INFO nova.api.openstack.requestlog [None req-730eb8f4-f661-4b3b-a1ba-5c43f4fa5bd7 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.133997 May 27 03:34:31.413368 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: [pid: 98161|app: 0|req: 15/28] 10.222.0.25 () {64 vars in 1282 bytes} [Thu May 27 03:34:31 2021] POST /compute/v2.1/flavors => generated 406 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:34:31.425025 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi [None req-4445f7ec-8631-4c6c-a473-ec044fbcf60c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=98160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:34:31.525659 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: INFO nova.api.openstack.requestlog [None req-4445f7ec-8631-4c6c-a473-ec044fbcf60c admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.104537 May 27 03:34:31.526338 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: [pid: 98160|app: 0|req: 14/29] 10.222.0.25 () {64 vars in 1332 bytes} [Thu May 27 03:34:31 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:34:33.642126 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi [None req-730eb8f4-f661-4b3b-a1ba-5c43f4fa5bd7 admin admin] Calling method '>' {{(pid=98161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:33.643761 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: INFO nova.api.openstack.requestlog [None req-730eb8f4-f661-4b3b-a1ba-5c43f4fa5bd7 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002073 May 27 03:34:33.644364 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: [pid: 98161|app: 0|req: 16/30] 10.222.0.25 () {54 vars in 930 bytes} [Thu May 27 03:34:33 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:34:33.709419 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi [None req-4de9430e-e004-47ad-b1b6-f4adc8573b88 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 8192, "disk": 80, "vcpus": 4, "swap": 0, "rxtx_factor": 1.0, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large"}} {{(pid=98160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:34:33.802260 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: INFO nova.api.openstack.requestlog [None req-4de9430e-e004-47ad-b1b6-f4adc8573b88 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.151297 May 27 03:34:33.806360 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: [pid: 98160|app: 0|req: 15/31] 10.222.0.25 () {64 vars in 1282 bytes} [Thu May 27 03:34:33 2021] POST /compute/v2.1/flavors => generated 405 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:34:33.819276 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi [None req-79f52198-78c8-403b-92b5-c4ebe6629f8c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=98161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:34:33.931945 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: INFO nova.api.openstack.requestlog [None req-79f52198-78c8-403b-92b5-c4ebe6629f8c admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.120560 May 27 03:34:33.944979 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: [pid: 98161|app: 0|req: 17/32] 10.222.0.25 () {64 vars in 1332 bytes} [Thu May 27 03:34:33 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:34:36.148594 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi [None req-4de9430e-e004-47ad-b1b6-f4adc8573b88 admin admin] Calling method '>' {{(pid=98160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:34:36.148594 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: INFO nova.api.openstack.requestlog [None req-4de9430e-e004-47ad-b1b6-f4adc8573b88 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 May 27 03:34:36.148594 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: [pid: 98160|app: 0|req: 16/33] 10.222.0.25 () {54 vars in 930 bytes} [Thu May 27 03:34:36 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:34:36.186633 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi [None req-74d110e6-3adc-449f-bded-7ed674ed000b admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "swap": 0, "vcpus": 8, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.xlarge", "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5"}} {{(pid=98161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:34:36.949659 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: INFO nova.api.openstack.requestlog [None req-74d110e6-3adc-449f-bded-7ed674ed000b admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.830972 May 27 03:34:36.950334 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: [pid: 98161|app: 0|req: 18/34] 10.222.0.25 () {64 vars in 1282 bytes} [Thu May 27 03:34:36 2021] POST /compute/v2.1/flavors => generated 408 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:34:36.963898 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi [None req-049fc895-e910-46c7-b0ae-e835d73a23a2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=98160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:34:37.140823 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: INFO nova.api.openstack.requestlog [None req-049fc895-e910-46c7-b0ae-e835d73a23a2 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.180456 May 27 03:34:37.141531 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: [pid: 98160|app: 0|req: 17/35] 10.222.0.25 () {64 vars in 1332 bytes} [Thu May 27 03:34:36 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:35:14.375674 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi [None req-74d110e6-3adc-449f-bded-7ed674ed000b admin admin] Calling method '>' {{(pid=98161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:14.376804 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: INFO nova.api.openstack.requestlog [None req-74d110e6-3adc-449f-bded-7ed674ed000b admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001551 May 27 03:35:14.377200 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: [pid: 98161|app: 0|req: 19/36] 10.222.0.25 () {54 vars in 930 bytes} [Thu May 27 03:35:14 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:35:14.433578 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi [None req-090ad74a-e734-4c94-baf7-337e85bda6ae admin admin] Calling method '>' {{(pid=98160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:14.457116 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: INFO nova.api.openstack.requestlog [None req-090ad74a-e734-4c94-baf7-337e85bda6ae admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.073259 May 27 03:35:14.457652 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: [pid: 98160|app: 0|req: 18/37] 10.222.0.25 () {60 vars in 1291 bytes} [Thu May 27 03:35:14 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:35:15.814028 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi [None req-74d110e6-3adc-449f-bded-7ed674ed000b admin admin] Calling method '>' {{(pid=98161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:15.815024 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: INFO nova.api.openstack.requestlog [None req-74d110e6-3adc-449f-bded-7ed674ed000b admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 May 27 03:35:15.815989 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: [pid: 98161|app: 0|req: 20/38] 10.222.0.25 () {56 vars in 1075 bytes} [Thu May 27 03:35:15 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:35:16.001084 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi [None req-405d2425-4d45-49b8-acb2-a8d52cb8087e admin admin] Calling method '>' {{(pid=98160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:16.013792 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: INFO nova.api.openstack.wsgi [None req-405d2425-4d45-49b8-acb2-a8d52cb8087e admin admin] HTTP exception thrown: Flavor 42 could not be found. May 27 03:35:16.014362 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi [None req-405d2425-4d45-49b8-acb2-a8d52cb8087e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=98160) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 27 03:35:16.015154 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: INFO nova.api.openstack.requestlog [None req-405d2425-4d45-49b8-acb2-a8d52cb8087e admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.064348 May 27 03:35:16.015672 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: [pid: 98160|app: 0|req: 19/39] 10.222.0.25 () {60 vars in 1191 bytes} [Thu May 27 03:35:15 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 27 03:35:16.025433 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi [None req-7d8a2326-e88f-4469-873b-2db74cd25513 admin admin] Calling method '>' {{(pid=98161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:16.045379 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: INFO nova.api.openstack.requestlog [None req-7d8a2326-e88f-4469-873b-2db74cd25513 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.023488 May 27 03:35:16.045905 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: [pid: 98161|app: 0|req: 21/40] 10.222.0.25 () {60 vars in 1211 bytes} [Thu May 27 03:35:16 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:35:16.055678 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi [None req-9190c957-103b-452b-8d55-6f6a54039f2e admin admin] Calling method '>' {{(pid=98160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:16.075389 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: INFO nova.api.openstack.requestlog [None req-9190c957-103b-452b-8d55-6f6a54039f2e admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.023463 May 27 03:35:16.075934 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: [pid: 98160|app: 0|req: 20/41] 10.222.0.25 () {60 vars in 1211 bytes} [Thu May 27 03:35:16 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:35:16.085368 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi [None req-4d2fc747-d25f-45e9-9a29-b5c4a66e7884 admin admin] Calling method '>' {{(pid=98161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:16.097476 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: INFO nova.api.openstack.wsgi [None req-4d2fc747-d25f-45e9-9a29-b5c4a66e7884 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 27 03:35:16.098044 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi [None req-4d2fc747-d25f-45e9-9a29-b5c4a66e7884 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=98161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 27 03:35:16.098823 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: INFO nova.api.openstack.requestlog [None req-4d2fc747-d25f-45e9-9a29-b5c4a66e7884 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.016922 May 27 03:35:16.099311 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: [pid: 98161|app: 0|req: 22/42] 10.222.0.25 () {60 vars in 1191 bytes} [Thu May 27 03:35:16 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 27 03:35:17.402751 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi [None req-9190c957-103b-452b-8d55-6f6a54039f2e admin admin] Calling method '>' {{(pid=98160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:17.403747 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: INFO nova.api.openstack.requestlog [None req-9190c957-103b-452b-8d55-6f6a54039f2e admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 May 27 03:35:17.404140 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: [pid: 98160|app: 0|req: 21/43] 10.222.0.25 () {56 vars in 1075 bytes} [Thu May 27 03:35:17 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:35:17.587112 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi [None req-8465ba34-be8c-4e5c-96e4-d0f2c1dfc1d1 admin admin] Calling method '>' {{(pid=98161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:17.599007 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: INFO nova.api.openstack.wsgi [None req-8465ba34-be8c-4e5c-96e4-d0f2c1dfc1d1 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 27 03:35:17.599581 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi [None req-8465ba34-be8c-4e5c-96e4-d0f2c1dfc1d1 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=98161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 27 03:35:17.600384 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: INFO nova.api.openstack.requestlog [None req-8465ba34-be8c-4e5c-96e4-d0f2c1dfc1d1 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.063246 May 27 03:35:17.600917 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: [pid: 98161|app: 0|req: 23/44] 10.222.0.25 () {60 vars in 1191 bytes} [Thu May 27 03:35:17 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 27 03:35:17.609969 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi [None req-074fd62e-d5b3-4e8d-8243-63f1476c7b87 admin admin] Calling method '>' {{(pid=98160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:17.629737 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: INFO nova.api.openstack.requestlog [None req-074fd62e-d5b3-4e8d-8243-63f1476c7b87 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.023356 May 27 03:35:17.630258 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: [pid: 98160|app: 0|req: 22/45] 10.222.0.25 () {60 vars in 1211 bytes} [Thu May 27 03:35:17 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:35:17.639344 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi [None req-89b40ce1-0a0d-4afe-9576-c286e2874365 admin admin] Calling method '>' {{(pid=98161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:17.661404 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: INFO nova.api.openstack.requestlog [None req-89b40ce1-0a0d-4afe-9576-c286e2874365 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.025427 May 27 03:35:17.661937 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: [pid: 98161|app: 0|req: 24/46] 10.222.0.25 () {60 vars in 1211 bytes} [Thu May 27 03:35:17 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:35:17.670960 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi [None req-227ba9cc-f847-40c4-99c7-f7c73eba996b admin admin] Calling method '>' {{(pid=98160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:17.685042 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: INFO nova.api.openstack.wsgi [None req-227ba9cc-f847-40c4-99c7-f7c73eba996b admin admin] HTTP exception thrown: Flavor 84 could not be found. May 27 03:35:17.685620 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi [None req-227ba9cc-f847-40c4-99c7-f7c73eba996b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=98160) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 27 03:35:17.686418 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: INFO nova.api.openstack.requestlog [None req-227ba9cc-f847-40c4-99c7-f7c73eba996b admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.019071 May 27 03:35:17.686922 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: [pid: 98160|app: 0|req: 23/47] 10.222.0.25 () {60 vars in 1191 bytes} [Thu May 27 03:35:17 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 27 03:35:18.973136 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi [None req-89b40ce1-0a0d-4afe-9576-c286e2874365 admin admin] Calling method '>' {{(pid=98161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:18.974152 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: INFO nova.api.openstack.requestlog [None req-89b40ce1-0a0d-4afe-9576-c286e2874365 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002082 May 27 03:35:18.974553 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: [pid: 98161|app: 0|req: 25/48] 10.222.0.25 () {56 vars in 1075 bytes} [Thu May 27 03:35:18 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:35:19.162044 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi [None req-f8d9761b-bc64-4833-9f23-0571b7b3d5a5 admin admin] Calling method '>' {{(pid=98160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:19.173861 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: INFO nova.api.openstack.wsgi [None req-f8d9761b-bc64-4833-9f23-0571b7b3d5a5 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 27 03:35:19.174434 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi [None req-f8d9761b-bc64-4833-9f23-0571b7b3d5a5 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=98160) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 27 03:35:19.175242 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: INFO nova.api.openstack.requestlog [None req-f8d9761b-bc64-4833-9f23-0571b7b3d5a5 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.063195 May 27 03:35:19.175793 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: [pid: 98160|app: 0|req: 24/49] 10.222.0.25 () {60 vars in 1194 bytes} [Thu May 27 03:35:19 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 27 03:35:19.185026 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi [None req-17cd9c78-6009-48ba-9787-48d201e8533c admin admin] Calling method '>' {{(pid=98161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:19.207468 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: INFO nova.api.openstack.requestlog [None req-17cd9c78-6009-48ba-9787-48d201e8533c admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.025331 May 27 03:35:19.208012 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: [pid: 98161|app: 0|req: 26/50] 10.222.0.25 () {60 vars in 1211 bytes} [Thu May 27 03:35:19 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:35:19.217361 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi [None req-15a1f534-bdbf-4248-9d1e-9908447ee728 admin admin] Calling method '>' {{(pid=98160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:19.236776 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: INFO nova.api.openstack.requestlog [None req-15a1f534-bdbf-4248-9d1e-9908447ee728 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.022862 May 27 03:35:19.237296 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: [pid: 98160|app: 0|req: 25/51] 10.222.0.25 () {60 vars in 1211 bytes} [Thu May 27 03:35:19 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:35:19.246074 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi [None req-b2e05e8d-9824-4101-b10f-b5f06f0ff1d2 admin admin] Calling method '>' {{(pid=98161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:19.258235 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: INFO nova.api.openstack.wsgi [None req-b2e05e8d-9824-4101-b10f-b5f06f0ff1d2 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 27 03:35:19.258807 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi [None req-b2e05e8d-9824-4101-b10f-b5f06f0ff1d2 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=98161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 27 03:35:19.259594 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: INFO nova.api.openstack.requestlog [None req-b2e05e8d-9824-4101-b10f-b5f06f0ff1d2 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.016979 May 27 03:35:19.260087 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: [pid: 98161|app: 0|req: 27/52] 10.222.0.25 () {60 vars in 1194 bytes} [Thu May 27 03:35:19 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 27 03:35:20.543294 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi [None req-15a1f534-bdbf-4248-9d1e-9908447ee728 admin admin] Calling method '>' {{(pid=98160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:20.544291 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: INFO nova.api.openstack.requestlog [None req-15a1f534-bdbf-4248-9d1e-9908447ee728 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 May 27 03:35:20.544712 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: [pid: 98160|app: 0|req: 26/53] 10.222.0.25 () {56 vars in 1075 bytes} [Thu May 27 03:35:20 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:35:20.731305 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi [None req-f42175ff-c9c6-4c42-92a8-80617b85ed57 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=98161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:35:20.812661 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: INFO nova.api.openstack.requestlog [None req-f42175ff-c9c6-4c42-92a8-80617b85ed57 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.88 time: 0.131086 May 27 03:35:20.813212 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: [pid: 98161|app: 0|req: 28/54] 10.222.0.25 () {64 vars in 1236 bytes} [Thu May 27 03:35:20 2021] POST /compute/v2.1/flavors => generated 404 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:35:22.109335 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi [None req-15a1f534-bdbf-4248-9d1e-9908447ee728 admin admin] Calling method '>' {{(pid=98160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:22.110327 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: INFO nova.api.openstack.requestlog [None req-15a1f534-bdbf-4248-9d1e-9908447ee728 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001402 May 27 03:35:22.110717 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: [pid: 98160|app: 0|req: 27/55] 10.222.0.25 () {56 vars in 1075 bytes} [Thu May 27 03:35:22 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:35:22.295155 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi [None req-b0824496-9ada-443e-92fe-5659f71882bc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=98161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:35:22.377531 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: INFO nova.api.openstack.requestlog [None req-b0824496-9ada-443e-92fe-5659f71882bc admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.88 time: 0.131671 May 27 03:35:22.377995 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: [pid: 98161|app: 0|req: 29/56] 10.222.0.25 () {64 vars in 1236 bytes} [Thu May 27 03:35:22 2021] POST /compute/v2.1/flavors => generated 405 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 03:35:23.676745 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi [None req-15a1f534-bdbf-4248-9d1e-9908447ee728 admin admin] Calling method '>' {{(pid=98160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:23.678000 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: INFO nova.api.openstack.requestlog [None req-15a1f534-bdbf-4248-9d1e-9908447ee728 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002384 May 27 03:35:23.678394 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: [pid: 98160|app: 0|req: 28/57] 10.222.0.25 () {56 vars in 1075 bytes} [Thu May 27 03:35:23 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:35:23.864913 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi [None req-eca3c8b3-0fe9-4a71-b07b-1fd1097fa4d4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=98161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:35:23.979784 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: INFO nova.api.openstack.requestlog [None req-eca3c8b3-0fe9-4a71-b07b-1fd1097fa4d4 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.88 time: 0.165065 May 27 03:35:23.980254 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: [pid: 98161|app: 0|req: 30/58] 10.222.0.25 () {64 vars in 1236 bytes} [Thu May 27 03:35:23 2021] POST /compute/v2.1/flavors => generated 407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:35:25.268811 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi [None req-15a1f534-bdbf-4248-9d1e-9908447ee728 admin admin] Calling method '>' {{(pid=98160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:25.270396 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: INFO nova.api.openstack.requestlog [None req-15a1f534-bdbf-4248-9d1e-9908447ee728 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002022 May 27 03:35:25.270797 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: [pid: 98160|app: 0|req: 29/59] 10.222.0.25 () {56 vars in 1075 bytes} [Thu May 27 03:35:25 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:35:25.456313 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi [None req-21213a36-c949-4682-9ae6-8f80ec9683b1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=98161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:35:25.537063 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: INFO nova.api.openstack.requestlog [None req-21213a36-c949-4682-9ae6-8f80ec9683b1 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.88 time: 0.130196 May 27 03:35:25.537605 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: [pid: 98161|app: 0|req: 31/60] 10.222.0.25 () {64 vars in 1236 bytes} [Thu May 27 03:35:25 2021] POST /compute/v2.1/flavors => generated 409 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:35:26.824699 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi [None req-15a1f534-bdbf-4248-9d1e-9908447ee728 admin admin] Calling method '>' {{(pid=98160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:26.826119 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: INFO nova.api.openstack.requestlog [None req-15a1f534-bdbf-4248-9d1e-9908447ee728 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 May 27 03:35:26.826262 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: [pid: 98160|app: 0|req: 30/61] 10.222.0.25 () {56 vars in 1075 bytes} [Thu May 27 03:35:26 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:35:27.011892 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi [None req-85078406-f6ce-4f45-9962-619eded3258d admin admin] Calling method '>' {{(pid=98161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:35:27.039041 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: INFO nova.api.openstack.requestlog [None req-85078406-f6ce-4f45-9962-619eded3258d admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.076772 May 27 03:35:27.039503 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: [pid: 98161|app: 0|req: 32/62] 10.222.0.25 () {60 vars in 1203 bytes} [Thu May 27 03:35:26 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:36:10.466856 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi [None req-15a1f534-bdbf-4248-9d1e-9908447ee728 admin admin] Calling method '>' {{(pid=98160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:36:10.467927 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: INFO nova.api.openstack.requestlog [None req-15a1f534-bdbf-4248-9d1e-9908447ee728 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 May 27 03:36:10.468392 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: [pid: 98160|app: 0|req: 31/63] 10.222.0.25 () {56 vars in 1075 bytes} [Thu May 27 03:36:10 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:36:10.656629 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi [None req-c9e7e8cb-1877-417b-b980-93b79c57cd83 admin admin] Calling method '>' {{(pid=98161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:36:10.682097 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: INFO nova.api.openstack.requestlog [None req-c9e7e8cb-1877-417b-b980-93b79c57cd83 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.074272 May 27 03:36:10.682561 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: [pid: 98161|app: 0|req: 33/64] 10.222.0.25 () {60 vars in 1203 bytes} [Thu May 27 03:36:10 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:37:46.727115 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi [None req-d6129a5c-7da2-4f5d-bab9-a519b35a7945 tempest-verify_tempest_config-931240682 tempest-verify_tempest_config-931240682-project] Calling method '>' {{(pid=98160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:37:46.729156 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: INFO nova.api.openstack.requestlog [None req-d6129a5c-7da2-4f5d-bab9-a519b35a7945 tempest-verify_tempest_config-931240682 tempest-verify_tempest_config-931240682-project] 10.222.0.25 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.111263 May 27 03:37:46.729678 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: [pid: 98160|app: 0|req: 32/65] 10.222.0.25 () {58 vars in 1134 bytes} [Thu May 27 03:37:46 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:39:14.122028 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi [None req-c9e7e8cb-1877-417b-b980-93b79c57cd83 admin admin] Calling method '>' {{(pid=98161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:39:14.123112 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: INFO nova.api.openstack.requestlog [None req-c9e7e8cb-1877-417b-b980-93b79c57cd83 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001589 May 27 03:39:14.123504 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: [pid: 98161|app: 0|req: 34/66] 10.222.0.25 () {56 vars in 1075 bytes} [Thu May 27 03:39:14 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:39:14.373421 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi [None req-e879199c-2798-4e8a-bfb1-0ffed8f08e0f admin admin] Calling method '>' {{(pid=98160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:39:14.374617 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:39:14.374617 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: warnings.warn(msg) May 27 03:39:14.376175 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG oslo_concurrency.lockutils [None req-e879199c-2798-4e8a-bfb1-0ffed8f08e0f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:39:14.376656 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG oslo_concurrency.lockutils [None req-e879199c-2798-4e8a-bfb1-0ffed8f08e0f admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:39:14.377452 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG oslo_concurrency.lockutils [None req-e879199c-2798-4e8a-bfb1-0ffed8f08e0f admin admin] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:39:14.378484 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG oslo_concurrency.lockutils [None req-e879199c-2798-4e8a-bfb1-0ffed8f08e0f admin admin] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:39:14.413892 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: INFO nova.api.openstack.requestlog [None req-e879199c-2798-4e8a-bfb1-0ffed8f08e0f admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.88 time: 0.153994 May 27 03:39:14.414442 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: [pid: 98160|app: 0|req: 33/67] 10.222.0.25 () {60 vars in 1194 bytes} [Thu May 27 03:39:14 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:39:15.723632 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: DEBUG nova.api.openstack.wsgi [None req-c9e7e8cb-1877-417b-b980-93b79c57cd83 admin admin] Calling method '>' {{(pid=98161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:39:15.724671 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: INFO nova.api.openstack.requestlog [None req-c9e7e8cb-1877-417b-b980-93b79c57cd83 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 May 27 03:39:15.725067 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: [pid: 98161|app: 0|req: 35/68] 10.222.0.25 () {56 vars in 1075 bytes} [Thu May 27 03:39:15 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:39:15.911438 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG nova.api.openstack.wsgi [None req-cb76e4e4-0b71-4338-8c51-622e35fed32d admin admin] Calling method '>' {{(pid=98160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:39:15.912602 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:39:15.912602 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: warnings.warn(msg) May 27 03:39:15.914101 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG oslo_concurrency.lockutils [None req-cb76e4e4-0b71-4338-8c51-622e35fed32d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:39:15.914567 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG oslo_concurrency.lockutils [None req-cb76e4e4-0b71-4338-8c51-622e35fed32d admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:39:15.915346 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG oslo_concurrency.lockutils [None req-cb76e4e4-0b71-4338-8c51-622e35fed32d admin admin] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:39:15.915773 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: DEBUG oslo_concurrency.lockutils [None req-cb76e4e4-0b71-4338-8c51-622e35fed32d admin admin] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:39:15.941277 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: INFO nova.api.openstack.requestlog [None req-cb76e4e4-0b71-4338-8c51-622e35fed32d admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.88 time: 0.079514 May 27 03:39:15.941758 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: [pid: 98160|app: 0|req: 34/69] 10.222.0.25 () {60 vars in 1194 bytes} [Thu May 27 03:39:15 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:40:09.372493 dv-cinder-793264-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 27 03:40:09.373824 dv-cinder-793264-1-iscsi devstack@n-api.service[98159]: Thu May 27 03:40:09 2021 - graceful shutdown triggered... May 27 03:40:09.374273 dv-cinder-793264-1-iscsi devstack@n-api.service[98160]: Gracefully killing worker 1 (pid: 98160)... May 27 03:40:09.374718 dv-cinder-793264-1-iscsi devstack@n-api.service[98161]: Gracefully killing worker 2 (pid: 98161)... May 27 03:40:10.374350 dv-cinder-793264-1-iscsi devstack@n-api.service[98159]: worker 1 buried after 1 seconds May 27 03:40:10.374350 dv-cinder-793264-1-iscsi devstack@n-api.service[98159]: worker 2 buried after 1 seconds May 27 03:40:10.374350 dv-cinder-793264-1-iscsi devstack@n-api.service[98159]: goodbye to uWSGI. May 27 03:40:10.376011 dv-cinder-793264-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 27 03:40:10.376579 dv-cinder-793264-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 27 03:40:10.379610 dv-cinder-793264-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 27 03:40:10.388915 dv-cinder-793264-1-iscsi devstack@n-api.service[113002]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 27 03:40:10.391493 dv-cinder-793264-1-iscsi devstack@n-api.service[113002]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 27 03:40:10 2021] *** May 27 03:40:10.392118 dv-cinder-793264-1-iscsi devstack@n-api.service[113002]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 27 03:40:10.392253 dv-cinder-793264-1-iscsi devstack@n-api.service[113002]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 27 03:40:10.392380 dv-cinder-793264-1-iscsi devstack@n-api.service[113002]: nodename: dv-cinder-793264-1-iscsi May 27 03:40:10.392612 dv-cinder-793264-1-iscsi devstack@n-api.service[113002]: machine: x86_64 May 27 03:40:10.392716 dv-cinder-793264-1-iscsi devstack@n-api.service[113002]: clock source: unix May 27 03:40:10.392807 dv-cinder-793264-1-iscsi devstack@n-api.service[113002]: pcre jit disabled May 27 03:40:10.392902 dv-cinder-793264-1-iscsi devstack@n-api.service[113002]: detected number of CPU cores: 4 May 27 03:40:10.393007 dv-cinder-793264-1-iscsi devstack@n-api.service[113002]: current working directory: / May 27 03:40:10.393114 dv-cinder-793264-1-iscsi devstack@n-api.service[113002]: detected binary path: /usr/bin/uwsgi-core May 27 03:40:10.393227 dv-cinder-793264-1-iscsi devstack@n-api.service[113002]: your processes number limit is 47680 May 27 03:40:10.393352 dv-cinder-793264-1-iscsi devstack@n-api.service[113002]: your memory page size is 4096 bytes May 27 03:40:10.393462 dv-cinder-793264-1-iscsi devstack@n-api.service[113002]: detected max file descriptor number: 2048 May 27 03:40:10.393607 dv-cinder-793264-1-iscsi devstack@n-api.service[113002]: lock engine: pthread robust mutexes May 27 03:40:10.393902 dv-cinder-793264-1-iscsi devstack@n-api.service[113002]: thunder lock: enabled May 27 03:40:10.394204 dv-cinder-793264-1-iscsi devstack@n-api.service[113002]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 27 03:40:10.394410 dv-cinder-793264-1-iscsi devstack@n-api.service[113002]: Python version: 3.8.5 (default, Jan 27 2021, 15:41:15) [GCC 9.3.0] May 27 03:40:10.438355 dv-cinder-793264-1-iscsi devstack@n-api.service[113002]: Python main interpreter initialized at 0x55f42d95f9c0 May 27 03:40:10.438355 dv-cinder-793264-1-iscsi devstack@n-api.service[113002]: python threads support enabled May 27 03:40:10.438355 dv-cinder-793264-1-iscsi devstack@n-api.service[113002]: your server socket listen backlog is limited to 100 connections May 27 03:40:10.438355 dv-cinder-793264-1-iscsi devstack@n-api.service[113002]: your mercy for graceful operations on workers is 90 seconds May 27 03:40:10.438830 dv-cinder-793264-1-iscsi devstack@n-api.service[113002]: mapped 403077 bytes (393 KB) for 2 cores May 27 03:40:10.438830 dv-cinder-793264-1-iscsi devstack@n-api.service[113002]: *** Operational MODE: preforking *** May 27 03:40:10.439092 dv-cinder-793264-1-iscsi devstack@n-api.service[113002]: *** uWSGI is running in multiple interpreter mode *** May 27 03:40:10.439092 dv-cinder-793264-1-iscsi devstack@n-api.service[113002]: spawned uWSGI master process (pid: 113002) May 27 03:40:10.439305 dv-cinder-793264-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 27 03:40:10.444456 dv-cinder-793264-1-iscsi devstack@n-api.service[113002]: spawned uWSGI worker 1 (pid: 113020, cores: 1) May 27 03:40:10.444456 dv-cinder-793264-1-iscsi devstack@n-api.service[113002]: spawned uWSGI worker 2 (pid: 113021, cores: 1) May 27 03:40:10.444456 dv-cinder-793264-1-iscsi devstack@n-api.service[113002]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 27 03:40:12.198060 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 03:40:12.198060 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: from cryptography.utils import int_from_bytes May 27 03:40:12.198731 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 03:40:12.198731 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: from cryptography.utils import int_from_bytes May 27 03:40:12.199586 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 03:40:12.199586 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: from cryptography.utils import int_from_bytes May 27 03:40:12.200088 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 03:40:12.200088 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: from cryptography.utils import int_from_bytes May 27 03:40:14.608755 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 27 03:40:14.609309 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 27 03:40:14.609585 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 27 03:40:14.609863 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 27 03:40:14.610127 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 27 03:40:14.611201 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.611531 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.611877 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.612190 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.612554 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.612875 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.613205 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.613533 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.613870 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.614200 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.614525 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.614857 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-793264-1-iscsi {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.615189 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.615526 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.615833 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.616155 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.616492 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.616827 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.617141 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.617576 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 27 03:40:14.617984 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.618084 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 27 03:40:14.618172 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.619677 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 27 03:40:14.619815 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.619815 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.619957 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 27 03:40:14.619957 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 27 03:40:14.620103 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.620103 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.620250 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.620327 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.620412 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.620507 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.620586 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.620666 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.620741 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.620818 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.620888 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.620970 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.621048 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.621413 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.621674 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-793264-1-iscsi {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.621674 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.622202 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.622454 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.622670 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.622670 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.623095 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.623319 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.623535 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.623776 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-793264-1-iscsi {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.624013 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.624242 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.624478 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.624734 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.624954 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.625172 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.625387 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.625601 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.625851 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.626091 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.626275 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.626498 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.626645 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.626828 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.626986 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.626986 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.627291 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.627459 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.627641 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.627868 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.628031 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.628183 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.628334 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.628521 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.628678 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.628829 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.628985 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.629128 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.629317 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.629473 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.629624 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.629767 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.629966 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.630859 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.631023 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.631178 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.631321 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.631473 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.631473 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.631794 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-793264-1-iscsi {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.631996 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.632145 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.632299 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.632482 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.632650 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.632794 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.632941 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.633089 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.633244 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.633394 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.633549 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.633706 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.633891 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.634055 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.634206 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.634353 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.634513 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.634657 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.634803 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.634953 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.635106 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.635248 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.635389 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.635536 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.635726 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.635913 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.636104 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.636273 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.636873 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.637038 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.637195 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.637347 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.637498 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.637646 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.637795 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.637979 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.638138 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.638289 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.638432 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.638573 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.638726 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.638881 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.639033 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.639186 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.639347 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.639491 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.639633 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.639781 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.639938 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.640116 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.640116 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.641139 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.641296 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.641474 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.641626 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.641778 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.641921 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.642110 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.642267 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.642426 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.642426 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.642713 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.642863 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.643005 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.643162 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.643316 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.643483 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.643630 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.643779 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.643932 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.644085 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.644260 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.644439 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.644676 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.644837 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.644987 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.645144 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.645288 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.645437 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.645590 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.645740 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.645882 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.646108 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.646260 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.646409 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.646558 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.646708 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.646856 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.647008 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.647151 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.647301 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.647461 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.647616 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.647774 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.647926 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.648069 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.648217 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.648371 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.648555 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.648714 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.648864 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.649007 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.649148 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.649288 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.649447 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.649600 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.649789 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.649945 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.650133 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.650281 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.650931 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.651256 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.651408 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.651561 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.651758 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.651942 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.652090 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.652277 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.652477 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.652628 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.652780 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.652924 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.653064 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.653204 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.653485 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.653655 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.653799 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.654046 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.654234 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.654377 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.654529 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.654681 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.654831 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.654974 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.655115 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.655262 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.655694 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.655859 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.656003 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.656145 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.656292 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.656463 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.656613 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.656780 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.656932 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.657082 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.657734 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.657877 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.658029 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.658209 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.658365 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.658515 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.658668 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.658822 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.658974 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.659134 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.659278 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.659432 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.659585 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.659734 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.659879 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.660020 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.660161 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.660348 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.660531 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.661199 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.661538 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.661692 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.661853 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.662009 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.662160 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.662304 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.662453 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.662604 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.662762 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.662913 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.663064 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.663213 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.663366 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.663517 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.663669 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.663828 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.663978 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.664121 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.664270 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.664444 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.664610 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.664753 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.664902 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.665046 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.665195 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.665346 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.665502 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.665668 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.665846 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.665995 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.666154 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.666341 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.666490 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.666640 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.666640 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.666917 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.666917 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.667210 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.667210 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.667494 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.667651 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.667915 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.668113 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.668269 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.668650 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:40:14.668816 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.669002 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.669187 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.669346 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.669491 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.669632 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.669774 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.670217 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.670387 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.670387 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.671272 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.671626 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.671779 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.671923 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.672073 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.672215 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.672367 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.672586 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.672742 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.673503 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.673667 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.673952 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.674105 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.674219 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.674327 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.674450 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.674571 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.674697 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.674807 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.674917 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.675034 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.675152 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.675274 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.675472 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.675747 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.675867 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.675986 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.676106 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.676227 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.676339 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.688255 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.688255 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.688633 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.688633 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.688935 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.689090 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.689248 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.689400 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.689545 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.689687 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.689842 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.689994 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.690137 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.690344 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.690527 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.690686 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.690840 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.691006 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.691690 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.692055 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.692206 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.692361 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.692623 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.692774 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.692917 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.693059 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.693207 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.693366 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.693511 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.693653 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.693800 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.693959 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.694111 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.694275 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.694427 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.694579 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.694723 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.694872 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.695024 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.695168 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.695310 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.695453 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.695595 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.695744 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.695953 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.696148 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.696296 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.696468 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.696629 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.696782 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.696935 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.697079 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.697220 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.697370 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.697520 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.697672 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.697825 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.697986 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.698128 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.698278 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.698421 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.698572 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.698716 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.698857 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.699022 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.699262 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.699411 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.699607 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.699754 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.699906 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.700048 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.700190 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.700347 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.700687 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.700842 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.700986 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.701127 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.701747 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.701910 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.702170 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.702416 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.702573 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.702732 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.702876 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.703034 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.703177 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.703326 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.703478 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.703621 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.703762 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.703919 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.704092 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.704281 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.704671 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.704828 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.704996 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.705738 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.705896 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.706043 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.706185 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.706327 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.706479 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.706622 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.706764 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.706906 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.707057 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.707210 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.707370 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.707515 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.707902 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.708058 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.708215 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.708564 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.708782 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.708931 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.709092 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.709250 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.709401 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.709545 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.709792 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.709963 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.710110 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.710263 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.710413 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.710564 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.710714 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.710896 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.711118 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.711276 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.711942 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.712096 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.712372 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.712644 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.712804 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.712987 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.713135 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.713279 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.713427 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.713570 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.713721 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.713872 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.714061 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.714216 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.714361 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.714511 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.714664 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.714814 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.714989 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.715144 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.715295 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.715449 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.715600 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.715744 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.715896 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.716069 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.716219 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.716370 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.716550 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.716694 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.716836 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.716999 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.717182 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.717345 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.717505 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.717654 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.717809 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.717976 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.718167 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.718338 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.718497 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.718656 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.718813 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.718961 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.719124 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.719313 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.719468 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.720123 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.720356 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.720557 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.720732 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.720732 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.721017 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.721017 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.721299 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.721448 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.722060 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.722221 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.722397 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.722654 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.722892 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.723057 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.723217 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.723217 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.723560 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.723722 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.723880 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.724043 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.724193 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.724374 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.724702 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.725015 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.725180 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.725330 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.725489 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.726969 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.727132 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.727283 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.727486 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.727650 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.727809 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.727960 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.728119 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.728277 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.728505 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.728667 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.728826 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.728987 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.729147 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.729311 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.729461 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.729609 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.729765 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.729913 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.730070 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.730230 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.730388 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.730538 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.730686 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.730686 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.730995 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.731156 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.731306 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.731455 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.732351 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.733097 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.733273 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.733446 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.733728 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.733900 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.734053 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.734203 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.734377 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.734537 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.734696 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.734845 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.734992 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.735148 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.735356 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.736033 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.736204 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.736521 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.736718 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.736870 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.737029 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.737198 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.737356 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.737508 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.737888 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.738044 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.738208 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.738366 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.738526 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.738683 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.738842 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.739001 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.739151 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.739298 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.739465 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.739616 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.739772 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.739935 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.740085 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.740241 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.740425 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.740584 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.740733 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.740894 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.741043 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.741191 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.741348 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.741348 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.741654 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.741832 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.742449 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.742613 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.742772 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.743050 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.743870 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.744072 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.744229 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.744389 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.744687 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.745073 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.745234 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.745385 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.745545 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.745697 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.745846 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.745995 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.746143 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.746299 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.746465 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.746624 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.746788 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.746947 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.747107 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.747258 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.747493 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.747645 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.747801 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.747960 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.748110 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.748267 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.748468 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.748633 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.748793 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.748955 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.749104 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.749271 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.749421 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.749570 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.749718 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.749884 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.750264 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.750433 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.750585 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.750734 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.750912 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.751090 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.751261 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.751412 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.751568 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.751718 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.751876 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.752597 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.752792 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.752968 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.753240 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.753519 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.753803 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.753975 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.754238 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.754429 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.754583 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.754741 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.754906 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.755055 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.755211 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.755376 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.755376 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.755719 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.755892 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.756268 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.756463 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.756634 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.756794 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.756959 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.757108 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.757256 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.757505 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.757602 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.757682 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.757768 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.757847 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.757919 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.757988 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.758062 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.758133 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.758214 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.758307 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.758380 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.758448 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.758516 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.758929 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.759034 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.759115 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.759199 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.759302 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.759395 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.759479 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.759578 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.759675 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.759761 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.759853 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.759938 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.760019 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.760107 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.760197 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.760327 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.760448 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.760597 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.760705 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.760825 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.760926 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.761011 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.761106 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.761190 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.761272 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.761361 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.761444 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.761536 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.761536 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.761696 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.761778 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.761859 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.761939 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.762031 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.762115 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.762218 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.762611 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.762709 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.762795 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.762893 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.762986 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.763079 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.763170 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.763425 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.763532 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.763633 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.763718 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.763800 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.763889 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.763981 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.764074 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.764165 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.764250 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.764338 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.764451 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.764550 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.764644 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.764728 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.764809 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.764890 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.764970 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.765050 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.765149 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.765241 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.765324 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.765405 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.765486 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.765567 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.765660 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.765744 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.765833 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.765917 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.766006 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.766103 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.766193 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.766284 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.766380 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.766464 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.767068 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.767165 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.767249 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.767339 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.767339 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.767496 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.767587 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.767684 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.767775 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.767859 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.767940 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.768030 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.768122 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.768215 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.768299 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.768380 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.768580 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.768679 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.768767 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.768890 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.768992 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.769077 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.769159 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.769247 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.769409 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.769501 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.769585 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.769666 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.769666 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.769832 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.769928 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.770012 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.770102 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.770192 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.770284 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.770374 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.770466 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.770550 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.770640 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.770731 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.770814 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.770908 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.770999 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.771082 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.771170 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.771261 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.771344 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.771438 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.771522 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.771611 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.771695 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.771783 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.771874 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.771966 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.772056 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.772146 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.772229 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.772317 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.772432 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.772728 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.772823 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.772901 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.772970 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.773058 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.773157 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.773249 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.773358 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.773611 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.773706 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.773789 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.773881 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.773977 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.774061 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.774150 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.774241 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.774324 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.774415 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.774505 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.774588 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.774669 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.774757 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.774840 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.774931 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.775022 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.775105 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.775193 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.775276 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.775371 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.775462 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.775559 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.775643 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.775643 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.775810 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.775810 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.775976 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.776059 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.776144 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.776234 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.776324 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.776534 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.776683 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.776785 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.776870 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.776959 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.777050 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.777147 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.777231 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.777313 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.777395 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.777483 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.777581 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.777666 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.777747 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.777828 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.777908 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.777989 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.778083 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.778083 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.778249 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.778339 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.778429 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.778512 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.778623 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.778708 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.778796 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.778879 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.778968 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.778968 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.779126 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.779216 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.779306 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.779388 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.779476 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.779571 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.779654 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.779736 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.779824 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.779906 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.779994 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.780091 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.780182 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.780265 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.780354 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.780457 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.780541 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.780625 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.780696 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.780764 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.780878 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.780972 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.781054 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.781144 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.781144 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.781293 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.781371 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.781442 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.781519 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.781597 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.781675 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.781752 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.781752 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.781886 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.781886 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.782018 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.782094 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.782262 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.783116 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.783194 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.783282 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.783362 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.783438 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.783533 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.783777 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.783860 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.783942 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.784022 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.784092 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.784167 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.784237 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.784314 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.784391 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.784546 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.784627 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.784697 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.784766 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.784842 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.784947 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.785031 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.785109 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.785179 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.785246 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.785323 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.785400 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.785467 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.785542 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.785617 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.785687 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.785764 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.785844 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.785912 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.785988 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.786064 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.786143 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.786213 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.786280 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.786355 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.786432 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.786501 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.786647 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.786719 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.786787 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.786861 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.786931 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.787005 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.787084 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.787154 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.787221 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.787295 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.787379 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.787461 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.787532 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.787606 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.787675 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.787750 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.787831 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.787908 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.787977 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.788052 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.788120 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.788193 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.788271 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.788341 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.788437 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.788514 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.788582 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.788662 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.788742 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.788811 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.788879 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.788953 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.789022 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.789122 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.789205 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.789276 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.789343 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.789417 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.789493 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.789570 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.789646 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.789715 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.789783 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.789783 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.789783 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.789783 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.790046 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.790115 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.790182 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.790249 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.790324 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.790394 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.790460 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.790527 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.790593 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.790668 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.790744 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.790744 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.790875 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.790951 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.791021 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.791138 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.791138 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.791138 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.791138 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.791138 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.791525 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.791594 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.791676 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.791823 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.791918 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.792010 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.792101 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.792193 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.792278 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.792367 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.792519 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.792618 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.792960 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.793230 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.793326 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.793409 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.793497 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.793581 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.793662 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.793768 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.793867 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.793945 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.794015 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.794103 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.794187 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.794282 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.794366 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.794455 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.794537 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.794618 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.794708 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.794791 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.795116 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.795210 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.795292 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.795375 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.795542 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.795628 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.795710 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.795792 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.795883 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.795975 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.796048 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.796115 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.796191 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.796261 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.796343 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.796343 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.796529 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.796615 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.796704 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.796787 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.796869 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.796960 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.797045 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.797134 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.797218 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.797300 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.797389 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.797482 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.797572 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.797663 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.797768 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.797855 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.797952 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.798152 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.798265 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.798478 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.798578 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.798804 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.798972 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.799134 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.799226 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.799488 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.799665 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.799843 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.799993 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.800173 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.800341 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.800525 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.800710 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.800857 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.801050 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.801192 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.801382 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.801579 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.801713 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.801916 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.802057 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.802239 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.802380 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.802576 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.802687 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.802910 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.803011 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.803249 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.803413 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.803580 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.803707 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.803912 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.804041 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.804237 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.804436 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.804589 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.804697 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.804917 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.805011 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.805239 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.805330 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.805565 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.805786 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.805880 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.806154 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.806312 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.806481 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.806641 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.806825 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.806975 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.807164 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.807306 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.807494 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.807649 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.807817 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.807973 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.808170 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.808352 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.808540 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.808715 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.808834 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.809066 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.809157 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.809410 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.809511 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.809754 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.809847 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.810083 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.810206 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.810407 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.810526 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.810731 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.810834 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.811050 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.811162 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.811369 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.811508 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.811682 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.811783 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.812012 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.812112 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.812329 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.812463 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.815772 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.815891 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.815980 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.816054 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.816141 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.816235 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.816319 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.816391 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.816574 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.816654 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.816744 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.816819 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.816897 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.816968 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.817037 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.817105 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.817184 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.817184 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.817388 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.817460 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.817528 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.817597 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.817678 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.817757 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.817834 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.817961 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.818036 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.818121 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.818194 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.818262 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.818363 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.818442 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.818514 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.818592 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.818671 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.818742 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.818810 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.818881 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.818949 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.819097 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.819190 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.819629 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.819742 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.819831 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.819923 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.820065 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.820160 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.820382 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.820500 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.820749 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.820961 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.821054 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.821313 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.821408 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.821645 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.821748 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.821990 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.822091 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.822310 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.822413 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.822628 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.822730 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.822946 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.823046 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.823258 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.823350 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.823583 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.823677 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.823898 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.823994 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.824294 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.824439 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.824574 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.824677 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.824875 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.824998 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.825238 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.825333 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.825508 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.825611 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.826177 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.826262 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.826262 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.826398 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.826486 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.826736 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.826835 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.827088 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.827189 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.827414 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.827509 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.827739 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.827829 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.828066 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.828178 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.828391 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.828503 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.828739 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.828854 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.829618 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.829722 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.829949 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.830044 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.830267 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.830505 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.830607 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.830854 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.830960 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.831187 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.831290 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.831533 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.831626 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.831887 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.831980 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.832213 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.832307 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.832558 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.832673 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.832880 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.832977 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.833215 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.833317 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.833542 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.833645 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.833866 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.834000 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.834191 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.834292 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.834518 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.834641 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.834841 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.834944 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.835166 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.835267 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.835489 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.835597 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.835806 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.835903 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.836129 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.836231 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.836480 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.836602 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.836846 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.836940 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.837182 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.837282 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.837512 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.837613 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.837841 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.837942 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.838163 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.838257 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.838484 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.838573 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.838821 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.838922 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.839118 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.839221 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.839438 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.839539 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.839758 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.839858 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.840087 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.840181 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.840442 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.840540 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.840750 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.840844 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.841071 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.841176 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.841400 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.841497 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.841715 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.841816 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.842040 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.842157 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.842361 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.842467 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.842685 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.842779 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.843027 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.843135 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.843351 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.843446 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.843685 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.843787 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.844005 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.844114 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.844339 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.844466 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.845254 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.845362 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.845585 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.845691 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.845930 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.846063 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.846256 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.846361 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.846577 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.846672 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.846919 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.847014 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.847241 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.847334 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.847567 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.847670 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.847889 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.847987 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.848206 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.848299 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.848552 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.848649 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.848873 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.849003 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.849202 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.849309 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.849525 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.849620 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.849838 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.849930 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.850167 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.850278 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.850493 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.850587 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.850813 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.850905 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.851139 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.851249 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.851450 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.851551 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.851778 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.851872 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.852098 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.852204 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.852439 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.852551 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.852764 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.852868 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.853087 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.853189 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.853416 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.853510 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.853743 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.853876 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.854085 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.854189 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.854402 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.854506 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.854736 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.854900 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.855072 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.855168 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.855397 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.855491 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.855715 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.855817 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.856130 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.856246 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.856383 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.856562 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.856655 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=113021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 27 03:40:14.856755 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.857027 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.857350 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.857673 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.857995 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.858334 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.858675 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.858994 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.859333 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.859666 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.859998 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.860371 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.860751 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.861098 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.861424 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.861753 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.862080 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.862403 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.862732 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.863061 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.863404 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.863746 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.864086 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.864456 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.864825 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.865152 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.865513 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.865856 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:40:14.866248 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=113020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 27 03:40:14.892962 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_db.sqlalchemy.engines [None req-948b53d7-d0b4-4895-86d6-426aae272881 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113021) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 03:40:14.899539 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_db.sqlalchemy.engines [None req-01f037c3-b1cd-432a-ba2d-0334a2dc73cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113020) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 03:40:15.230506 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.context [None req-948b53d7-d0b4-4895-86d6-426aae272881 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),62df2d79-0f3c-4e85-ac9f-a1fbcca38810(cell1) {{(pid=113021) load_cells /opt/stack/nova/nova/context.py:464}} May 27 03:40:15.234941 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-948b53d7-d0b4-4895-86d6-426aae272881 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:40:15.235610 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.context [None req-01f037c3-b1cd-432a-ba2d-0334a2dc73cc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),62df2d79-0f3c-4e85-ac9f-a1fbcca38810(cell1) {{(pid=113020) load_cells /opt/stack/nova/nova/context.py:464}} May 27 03:40:15.236853 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-948b53d7-d0b4-4895-86d6-426aae272881 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:40:15.237685 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-948b53d7-d0b4-4895-86d6-426aae272881 None None] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:40:15.239812 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-948b53d7-d0b4-4895-86d6-426aae272881 None None] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:40:15.240038 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-01f037c3-b1cd-432a-ba2d-0334a2dc73cc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:40:15.241764 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-01f037c3-b1cd-432a-ba2d-0334a2dc73cc None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:40:15.242614 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-01f037c3-b1cd-432a-ba2d-0334a2dc73cc None None] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:40:15.244627 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-01f037c3-b1cd-432a-ba2d-0334a2dc73cc None None] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:40:15.266351 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_db.sqlalchemy.engines [None req-948b53d7-d0b4-4895-86d6-426aae272881 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113021) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 03:40:15.271291 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_db.sqlalchemy.engines [None req-01f037c3-b1cd-432a-ba2d-0334a2dc73cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113020) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 03:40:15.273317 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_db.sqlalchemy.engines [None req-948b53d7-d0b4-4895-86d6-426aae272881 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113021) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 03:40:15.281262 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_db.sqlalchemy.engines [None req-01f037c3-b1cd-432a-ba2d-0334a2dc73cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113020) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 03:40:15.299107 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_db.sqlalchemy.engines [None req-948b53d7-d0b4-4895-86d6-426aae272881 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113021) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 03:40:15.311159 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_db.sqlalchemy.engines [None req-01f037c3-b1cd-432a-ba2d-0334a2dc73cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113020) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 03:40:15.636197 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: WARNING keystonemiddleware.auth_token [None req-948b53d7-d0b4-4895-86d6-426aae272881 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 03:40:15.643982 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: WARNING keystonemiddleware.auth_token [None req-948b53d7-d0b4-4895-86d6-426aae272881 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 03:40:15.662690 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: WARNING keystonemiddleware.auth_token [None req-01f037c3-b1cd-432a-ba2d-0334a2dc73cc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 03:40:15.669679 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: WARNING keystonemiddleware.auth_token [None req-01f037c3-b1cd-432a-ba2d-0334a2dc73cc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 03:40:15.877524 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: WARNING keystonemiddleware.auth_token [None req-948b53d7-d0b4-4895-86d6-426aae272881 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 03:40:15.883208 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: WARNING keystonemiddleware.auth_token [None req-948b53d7-d0b4-4895-86d6-426aae272881 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 03:40:15.888387 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f42d95f9c0 pid: 113021 (default app) May 27 03:40:15.902245 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: WARNING keystonemiddleware.auth_token [None req-01f037c3-b1cd-432a-ba2d-0334a2dc73cc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 03:40:15.907687 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: WARNING keystonemiddleware.auth_token [None req-01f037c3-b1cd-432a-ba2d-0334a2dc73cc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 03:40:15.912852 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f42d95f9c0 pid: 113020 (default app) May 27 03:40:51.306286 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-9696343f-0166-46ed-b10f-2fa45c35aabb tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1912310428", "imageRef": "78c0913d-0e41-4b41-b38f-f45c4f2535ff", "flavorRef": "452", "networks": [{"uuid": "9d88eb5c-a234-4a0b-9721-bcab674f53e1"}]}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:40:52.052325 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.network.neutron [None req-9696343f-0166-46ed-b10f-2fa45c35aabb tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] validate_networks() for [('9d88eb5c-a234-4a0b-9721-bcab674f53e1', None, None, None)] {{(pid=113021) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 27 03:40:53.553848 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-8b333b29-abe3-46b9-88c1-ca636e8df5bf tempest-VolumesTestJSON-1481445738 tempest-VolumesTestJSON-1481445738-project] Calling method '.version_select at 0x7f9889e21dc0>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:53.811125 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.virt.hardware [None req-9696343f-0166-46ed-b10f-2fa45c35aabb tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Flavor limits 0:0:0 {{(pid=113021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 27 03:40:53.811631 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.virt.hardware [None req-9696343f-0166-46ed-b10f-2fa45c35aabb tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Image limits 0:0:0 {{(pid=113021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 27 03:40:53.812070 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.virt.hardware [None req-9696343f-0166-46ed-b10f-2fa45c35aabb tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Flavor pref 0:0:0 {{(pid=113021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 27 03:40:53.812514 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.virt.hardware [None req-9696343f-0166-46ed-b10f-2fa45c35aabb tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Image pref 0:0:0 {{(pid=113021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 27 03:40:53.812940 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.virt.hardware [None req-9696343f-0166-46ed-b10f-2fa45c35aabb tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=113021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 27 03:40:53.828430 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-9696343f-0166-46ed-b10f-2fa45c35aabb tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:40:53.829078 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-9696343f-0166-46ed-b10f-2fa45c35aabb tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:40:53.830679 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-9696343f-0166-46ed-b10f-2fa45c35aabb tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:40:53.831282 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-9696343f-0166-46ed-b10f-2fa45c35aabb tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:40:53.890591 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.quota [None req-9696343f-0166-46ed-b10f-2fa45c35aabb tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Getting quotas for project 7413f58ffa8e476fb5600cbc51ee9d34. Resources: {'instances', 'cores', 'ram'} {{(pid=113021) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 27 03:40:53.906579 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.quota [None req-9696343f-0166-46ed-b10f-2fa45c35aabb tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Getting quotas for user 925b5b18987f4e1eac67fda030a1714a and project 7413f58ffa8e476fb5600cbc51ee9d34. Resources: {'instances', 'cores', 'ram'} {{(pid=113021) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 27 03:40:53.935381 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-9696343f-0166-46ed-b10f-2fa45c35aabb tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Going to run 1 instances... {{(pid=113021) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 27 03:40:53.944198 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-9696343f-0166-46ed-b10f-2fa45c35aabb tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 695616b8-9b90-4e8d-b719-de3eabe09cbe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78c0913d-0e41-4b41-b38f-f45c4f2535ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=113021) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 27 03:40:54.218172 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-9696343f-0166-46ed-b10f-2fa45c35aabb tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.704392 May 27 03:40:54.218831 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 1/1] 10.222.0.25 () {60 vars in 1147 bytes} [Thu May 27 03:40:50 2021] POST /compute/v2.1/servers => generated 380 bytes in 3707 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 03:40:54.325786 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-8b333b29-abe3-46b9-88c1-ca636e8df5bf tempest-VolumesTestJSON-1481445738 tempest-VolumesTestJSON-1481445738-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/ec7f6414-8030-4049-b4b1-675c8f0a0cd0" status: 200 len: 351 microversion: 2.1 time: 1.274452 May 27 03:40:54.327202 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 1/2] 10.222.0.25 () {58 vars in 1245 bytes} [Thu May 27 03:40:53 2021] GET /compute/v2.1/os-volumes/ec7f6414-8030-4049-b4b1-675c8f0a0cd0 => generated 351 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:40:54.334400 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-980b755f-b178-4733-b1bc-82ae5043d75d tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:54.335231 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-980b755f-b178-4733-b1bc-82ae5043d75d tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 695616b8-9b90-4e8d-b719-de3eabe09cbe] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:40:54.660462 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-980b755f-b178-4733-b1bc-82ae5043d75d tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:54.681448 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-980b755f-b178-4733-b1bc-82ae5043d75d tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/695616b8-9b90-4e8d-b719-de3eabe09cbe" status: 200 len: 1218 microversion: 2.1 time: 0.351125 May 27 03:40:54.682175 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 2/3] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:40:54 2021] GET /compute/v2.1/servers/695616b8-9b90-4e8d-b719-de3eabe09cbe => generated 1218 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:54.685216 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-9d0ba3aa-99bc-4d15-856d-7210ae29854c tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1874176356", "imageRef": "78c0913d-0e41-4b41-b38f-f45c4f2535ff", "flavorRef": "452", "networks": [{"uuid": "e363b4db-219a-47f3-b982-5fb2e6fbad65"}]}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:40:54.835260 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.network.neutron [None req-9d0ba3aa-99bc-4d15-856d-7210ae29854c tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] validate_networks() for [('e363b4db-219a-47f3-b982-5fb2e6fbad65', None, None, None)] {{(pid=113021) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 27 03:40:55.700046 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-aef1127a-279f-40f8-8261-a07c8b82eb3b tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:55.700779 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-aef1127a-279f-40f8-8261-a07c8b82eb3b tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 695616b8-9b90-4e8d-b719-de3eabe09cbe] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:40:55.835386 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-aef1127a-279f-40f8-8261-a07c8b82eb3b tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:55.851922 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-aef1127a-279f-40f8-8261-a07c8b82eb3b tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/695616b8-9b90-4e8d-b719-de3eabe09cbe" status: 200 len: 1218 microversion: 2.1 time: 0.156040 May 27 03:40:55.852876 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 3/4] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:40:55 2021] GET /compute/v2.1/servers/695616b8-9b90-4e8d-b719-de3eabe09cbe => generated 1218 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:40:56.070590 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.virt.hardware [None req-9d0ba3aa-99bc-4d15-856d-7210ae29854c tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Flavor limits 0:0:0 {{(pid=113021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 27 03:40:56.071556 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.virt.hardware [None req-9d0ba3aa-99bc-4d15-856d-7210ae29854c tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Image limits 0:0:0 {{(pid=113021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 27 03:40:56.072047 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.virt.hardware [None req-9d0ba3aa-99bc-4d15-856d-7210ae29854c tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Flavor pref 0:0:0 {{(pid=113021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 27 03:40:56.072691 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.virt.hardware [None req-9d0ba3aa-99bc-4d15-856d-7210ae29854c tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Image pref 0:0:0 {{(pid=113021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 27 03:40:56.073460 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.virt.hardware [None req-9d0ba3aa-99bc-4d15-856d-7210ae29854c tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=113021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 27 03:40:56.082564 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-9d0ba3aa-99bc-4d15-856d-7210ae29854c tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:40:56.083467 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-9d0ba3aa-99bc-4d15-856d-7210ae29854c tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:40:56.089590 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-9d0ba3aa-99bc-4d15-856d-7210ae29854c tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:40:56.089590 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-9d0ba3aa-99bc-4d15-856d-7210ae29854c tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:40:56.136295 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.quota [None req-9d0ba3aa-99bc-4d15-856d-7210ae29854c tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Getting quotas for project f220b161db454279a529469cc181cb86. Resources: {'instances', 'cores', 'ram'} {{(pid=113021) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 27 03:40:56.141004 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.quota [None req-9d0ba3aa-99bc-4d15-856d-7210ae29854c tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Getting quotas for user 0207569193c64a2abbb1ae8f857d41d4 and project f220b161db454279a529469cc181cb86. Resources: {'instances', 'cores', 'ram'} {{(pid=113021) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 27 03:40:56.165880 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-9d0ba3aa-99bc-4d15-856d-7210ae29854c tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Going to run 1 instances... {{(pid=113021) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 27 03:40:56.167750 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-9d0ba3aa-99bc-4d15-856d-7210ae29854c tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] [instance: 5d5fdc92-2d08-4ae1-a508-032e39ce0958] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78c0913d-0e41-4b41-b38f-f45c4f2535ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=113021) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 27 03:40:56.353567 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-9d0ba3aa-99bc-4d15-856d-7210ae29854c tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.133213 May 27 03:40:56.357643 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 2/5] 10.222.0.25 () {60 vars in 1147 bytes} [Thu May 27 03:40:54 2021] POST /compute/v2.1/servers => generated 380 bytes in 2137 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 03:40:56.375359 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-258b3372-a9d0-441d-ad1c-52a1ea1812c5 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:56.376108 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-258b3372-a9d0-441d-ad1c-52a1ea1812c5 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] [instance: 5d5fdc92-2d08-4ae1-a508-032e39ce0958] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:40:56.649537 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-532a93e1-a7f1-4dc5-a237-7f070c097392 tempest-VolumesTestJSON-1481445738 tempest-VolumesTestJSON-1481445738-project] Calling method '.version_select at 0x7f9889c13550>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:56.671911 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-258b3372-a9d0-441d-ad1c-52a1ea1812c5 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0207569193c64a2abbb1ae8f857d41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f220b161db454279a529469cc181cb86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:56.685889 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-258b3372-a9d0-441d-ad1c-52a1ea1812c5 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] 10.222.0.25 "GET /compute/v2.1/servers/5d5fdc92-2d08-4ae1-a508-032e39ce0958" status: 200 len: 1215 microversion: 2.1 time: 0.320456 May 27 03:40:56.707193 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 4/6] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:40:56 2021] GET /compute/v2.1/servers/5d5fdc92-2d08-4ae1-a508-032e39ce0958 => generated 1215 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:56.870095 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-c30c50de-de90-4ec2-8194-7cc7c7d04010 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:56.870976 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-c30c50de-de90-4ec2-8194-7cc7c7d04010 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 695616b8-9b90-4e8d-b719-de3eabe09cbe] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:40:56.993218 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-c30c50de-de90-4ec2-8194-7cc7c7d04010 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:57.006837 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-c30c50de-de90-4ec2-8194-7cc7c7d04010 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/695616b8-9b90-4e8d-b719-de3eabe09cbe" status: 200 len: 1218 microversion: 2.1 time: 0.141533 May 27 03:40:57.007751 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 5/7] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:40:56 2021] GET /compute/v2.1/servers/695616b8-9b90-4e8d-b719-de3eabe09cbe => generated 1218 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:40:57.066163 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-532a93e1-a7f1-4dc5-a237-7f070c097392 tempest-VolumesTestJSON-1481445738 tempest-VolumesTestJSON-1481445738-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/f884264c-c64d-43d5-ac26-09f693a5bb8b" status: 200 len: 351 microversion: 2.1 time: 0.421049 May 27 03:40:57.067087 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 3/8] 10.222.0.25 () {58 vars in 1245 bytes} [Thu May 27 03:40:56 2021] GET /compute/v2.1/os-volumes/f884264c-c64d-43d5-ac26-09f693a5bb8b => generated 351 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:40:57.703300 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-87225de2-c7b1-4120-94a4-44083960d4ea tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:57.703928 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-87225de2-c7b1-4120-94a4-44083960d4ea tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] [instance: 5d5fdc92-2d08-4ae1-a508-032e39ce0958] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:40:57.952393 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-87225de2-c7b1-4120-94a4-44083960d4ea tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0207569193c64a2abbb1ae8f857d41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f220b161db454279a529469cc181cb86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:58.009749 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-87225de2-c7b1-4120-94a4-44083960d4ea tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] 10.222.0.25 "GET /compute/v2.1/servers/5d5fdc92-2d08-4ae1-a508-032e39ce0958" status: 200 len: 1215 microversion: 2.1 time: 0.310172 May 27 03:40:58.014554 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 6/9] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:40:57 2021] GET /compute/v2.1/servers/5d5fdc92-2d08-4ae1-a508-032e39ce0958 => generated 1215 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:58.027491 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-80cad0ab-2746-44e9-b356-dc4d98a71a70 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:58.034109 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-80cad0ab-2746-44e9-b356-dc4d98a71a70 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 695616b8-9b90-4e8d-b719-de3eabe09cbe] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:40:58.094362 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-80cad0ab-2746-44e9-b356-dc4d98a71a70 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:40:58.097180 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-80cad0ab-2746-44e9-b356-dc4d98a71a70 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:40:58.097180 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-80cad0ab-2746-44e9-b356-dc4d98a71a70 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:40:58.112895 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-80cad0ab-2746-44e9-b356-dc4d98a71a70 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:40:58.565194 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-80cad0ab-2746-44e9-b356-dc4d98a71a70 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:58.585264 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-80cad0ab-2746-44e9-b356-dc4d98a71a70 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/695616b8-9b90-4e8d-b719-de3eabe09cbe" status: 200 len: 1270 microversion: 2.1 time: 0.565863 May 27 03:40:58.596202 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 4/10] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:40:58 2021] GET /compute/v2.1/servers/695616b8-9b90-4e8d-b719-de3eabe09cbe => generated 1270 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:59.026454 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-42e45919-db95-47f3-a571-d1cbfa89d0e9 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:59.027131 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-42e45919-db95-47f3-a571-d1cbfa89d0e9 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] [instance: 5d5fdc92-2d08-4ae1-a508-032e39ce0958] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:40:59.041742 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-42e45919-db95-47f3-a571-d1cbfa89d0e9 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:40:59.043160 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-42e45919-db95-47f3-a571-d1cbfa89d0e9 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:40:59.044479 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-42e45919-db95-47f3-a571-d1cbfa89d0e9 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:40:59.047013 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-42e45919-db95-47f3-a571-d1cbfa89d0e9 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:40:59.374959 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-42e45919-db95-47f3-a571-d1cbfa89d0e9 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0207569193c64a2abbb1ae8f857d41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f220b161db454279a529469cc181cb86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:40:59.394907 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-42e45919-db95-47f3-a571-d1cbfa89d0e9 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] 10.222.0.25 "GET /compute/v2.1/servers/5d5fdc92-2d08-4ae1-a508-032e39ce0958" status: 200 len: 1219 microversion: 2.1 time: 0.368567 May 27 03:40:59.396090 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 7/11] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:40:59 2021] GET /compute/v2.1/servers/5d5fdc92-2d08-4ae1-a508-032e39ce0958 => generated 1219 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:40:59.602213 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-70d86775-5e04-4d9b-b280-83acc077e00a tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:59.602842 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-70d86775-5e04-4d9b-b280-83acc077e00a tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 695616b8-9b90-4e8d-b719-de3eabe09cbe] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:40:59.620894 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-70d86775-5e04-4d9b-b280-83acc077e00a tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:40:59.625457 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-70d86775-5e04-4d9b-b280-83acc077e00a tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:40:59.627096 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-70d86775-5e04-4d9b-b280-83acc077e00a tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:40:59.634248 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-70d86775-5e04-4d9b-b280-83acc077e00a tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:40:59.683098 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-2a01ef80-86cb-424f-921e-9fa3e8cf5bf1 tempest-VolumesTestJSON-1481445738 tempest-VolumesTestJSON-1481445738-project] Calling method '.version_select at 0x7f9889be5550>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:40:59.927441 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-2a01ef80-86cb-424f-921e-9fa3e8cf5bf1 tempest-VolumesTestJSON-1481445738 tempest-VolumesTestJSON-1481445738-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/d2f645bf-e437-414e-aca6-5687df88e425" status: 200 len: 351 microversion: 2.1 time: 0.247937 May 27 03:40:59.928151 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 8/12] 10.222.0.25 () {58 vars in 1245 bytes} [Thu May 27 03:40:59 2021] GET /compute/v2.1/os-volumes/d2f645bf-e437-414e-aca6-5687df88e425 => generated 351 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:40:59.943279 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-15c287b1-e650-45cf-8898-a206a41ceac7 tempest-VolumesTestJSON-1481445738 tempest-VolumesTestJSON-1481445738-project] Calling method '.version_select at 0x7f9889bd9a60>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:00.098434 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-15c287b1-e650-45cf-8898-a206a41ceac7 tempest-VolumesTestJSON-1481445738 tempest-VolumesTestJSON-1481445738-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.162213 May 27 03:41:00.108045 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 9/13] 10.222.0.25 () {58 vars in 1134 bytes} [Thu May 27 03:40:59 2021] GET /compute/v2.1/os-volumes => generated 1036 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:41:00.120006 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-9d27835a-a09c-479b-a4af-496eb177d938 tempest-VolumesTestJSON-1481445738 tempest-VolumesTestJSON-1481445738-project] Calling method '.version_select at 0x7f9889bd9c10>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:00.237500 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-70d86775-5e04-4d9b-b280-83acc077e00a tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:00.251887 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-70d86775-5e04-4d9b-b280-83acc077e00a tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/695616b8-9b90-4e8d-b719-de3eabe09cbe" status: 200 len: 1288 microversion: 2.1 time: 0.653767 May 27 03:41:00.264376 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 5/14] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:40:59 2021] GET /compute/v2.1/servers/695616b8-9b90-4e8d-b719-de3eabe09cbe => generated 1288 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:00.299736 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-9d27835a-a09c-479b-a4af-496eb177d938 tempest-VolumesTestJSON-1481445738 tempest-VolumesTestJSON-1481445738-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.189955 May 27 03:41:00.300378 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 10/15] 10.222.0.25 () {58 vars in 1149 bytes} [Thu May 27 03:41:00 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:41:00.313670 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-dd72189c-9e11-4d39-806c-b7b645a5d9ab tempest-VolumesTestJSON-1481445738 tempest-VolumesTestJSON-1481445738-project] Calling method '.version_select at 0x7f9889335790>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:00.415784 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-4f22ed72-ec1a-4297-b0b5-acca3b921d8d tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:00.416687 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-4f22ed72-ec1a-4297-b0b5-acca3b921d8d tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] [instance: 5d5fdc92-2d08-4ae1-a508-032e39ce0958] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:00.435856 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4f22ed72-ec1a-4297-b0b5-acca3b921d8d tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:00.445311 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4f22ed72-ec1a-4297-b0b5-acca3b921d8d tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:00.445311 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4f22ed72-ec1a-4297-b0b5-acca3b921d8d tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:00.445311 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4f22ed72-ec1a-4297-b0b5-acca3b921d8d tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:00.458121 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-dd72189c-9e11-4d39-806c-b7b645a5d9ab tempest-VolumesTestJSON-1481445738 tempest-VolumesTestJSON-1481445738-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.148965 May 27 03:41:00.459257 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 6/16] 10.222.0.25 () {58 vars in 1134 bytes} [Thu May 27 03:41:00 2021] GET /compute/v2.1/os-volumes => generated 1036 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:00.472204 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-fd64ace6-7889-41ba-bc85-888fbae0de87 tempest-VolumesTestJSON-1481445738 tempest-VolumesTestJSON-1481445738-project] Calling method '.version_select at 0x7f9889339310>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:00.671205 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-fd64ace6-7889-41ba-bc85-888fbae0de87 tempest-VolumesTestJSON-1481445738 tempest-VolumesTestJSON-1481445738-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.202963 May 27 03:41:00.671780 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 7/17] 10.222.0.25 () {58 vars in 1167 bytes} [Thu May 27 03:41:00 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:41:00.684740 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-c061f222-80a9-4a7f-9b38-e0c8c496ffad tempest-VolumesTestJSON-1481445738 tempest-VolumesTestJSON-1481445738-project] Calling method '.version_select at 0x7f98892de1f0>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:00.802076 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-c061f222-80a9-4a7f-9b38-e0c8c496ffad tempest-VolumesTestJSON-1481445738 tempest-VolumesTestJSON-1481445738-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.121260 May 27 03:41:00.810512 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 8/18] 10.222.0.25 () {58 vars in 1170 bytes} [Thu May 27 03:41:00 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:41:00.821521 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-9b1afe19-b876-49be-81b4-06dc4b458caf tempest-VolumesTestJSON-1481445738 tempest-VolumesTestJSON-1481445738-project] Calling method '.version_select at 0x7f9889335a60>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:00.992828 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-9b1afe19-b876-49be-81b4-06dc4b458caf tempest-VolumesTestJSON-1481445738 tempest-VolumesTestJSON-1481445738-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.181077 May 27 03:41:00.999995 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 9/19] 10.222.0.25 () {58 vars in 1155 bytes} [Thu May 27 03:41:00 2021] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:01.005948 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-39ac3f9d-9941-4ca4-a0de-269d5753b7fe tempest-VolumesTestJSON-1481445738 tempest-VolumesTestJSON-1481445738-project] Calling method '.version_select at 0x7f9889d909d0>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:01.131928 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-39ac3f9d-9941-4ca4-a0de-269d5753b7fe tempest-VolumesTestJSON-1481445738 tempest-VolumesTestJSON-1481445738-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.130482 May 27 03:41:01.132368 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 10/20] 10.222.0.25 () {58 vars in 1188 bytes} [Thu May 27 03:41:01 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:41:01.146577 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-f4e3a203-6dae-4ee2-9725-743ee7e965f6 tempest-VolumesTestJSON-1481445738 tempest-VolumesTestJSON-1481445738-project] Calling method '.version_select at 0x7f98892fa430>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:01.253190 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-f4e3a203-6dae-4ee2-9725-743ee7e965f6 tempest-VolumesTestJSON-1481445738 tempest-VolumesTestJSON-1481445738-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.112720 May 27 03:41:01.253776 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 11/21] 10.222.0.25 () {58 vars in 1155 bytes} [Thu May 27 03:41:01 2021] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:01.257182 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-4f22ed72-ec1a-4297-b0b5-acca3b921d8d tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0207569193c64a2abbb1ae8f857d41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f220b161db454279a529469cc181cb86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:01.277690 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-79ca8f82-ba28-482a-a89e-2465c4c8cf7f tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:01.278172 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-4f22ed72-ec1a-4297-b0b5-acca3b921d8d tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] 10.222.0.25 "GET /compute/v2.1/servers/5d5fdc92-2d08-4ae1-a508-032e39ce0958" status: 200 len: 1275 microversion: 2.1 time: 0.867966 May 27 03:41:01.278315 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-79ca8f82-ba28-482a-a89e-2465c4c8cf7f tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 695616b8-9b90-4e8d-b719-de3eabe09cbe] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:01.282021 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 11/22] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:00 2021] GET /compute/v2.1/servers/5d5fdc92-2d08-4ae1-a508-032e39ce0958 => generated 1275 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:01.297925 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-79ca8f82-ba28-482a-a89e-2465c4c8cf7f tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:01.307865 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-79ca8f82-ba28-482a-a89e-2465c4c8cf7f tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:01.308854 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-79ca8f82-ba28-482a-a89e-2465c4c8cf7f tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:01.309314 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-79ca8f82-ba28-482a-a89e-2465c4c8cf7f tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:01.656254 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-79ca8f82-ba28-482a-a89e-2465c4c8cf7f tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:01.674139 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-79ca8f82-ba28-482a-a89e-2465c4c8cf7f tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/695616b8-9b90-4e8d-b719-de3eabe09cbe" status: 200 len: 1276 microversion: 2.1 time: 0.404357 May 27 03:41:01.678417 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 12/23] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:01 2021] GET /compute/v2.1/servers/695616b8-9b90-4e8d-b719-de3eabe09cbe => generated 1276 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:02.299162 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-1825286a-f435-4be5-a7a5-e72a598aaa33 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:02.301023 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-1825286a-f435-4be5-a7a5-e72a598aaa33 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] [instance: 5d5fdc92-2d08-4ae1-a508-032e39ce0958] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:02.323574 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1825286a-f435-4be5-a7a5-e72a598aaa33 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:02.328331 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1825286a-f435-4be5-a7a5-e72a598aaa33 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:02.329864 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1825286a-f435-4be5-a7a5-e72a598aaa33 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:02.331974 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1825286a-f435-4be5-a7a5-e72a598aaa33 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:02.620837 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-1825286a-f435-4be5-a7a5-e72a598aaa33 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0207569193c64a2abbb1ae8f857d41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f220b161db454279a529469cc181cb86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:02.656777 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-1825286a-f435-4be5-a7a5-e72a598aaa33 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] 10.222.0.25 "GET /compute/v2.1/servers/5d5fdc92-2d08-4ae1-a508-032e39ce0958" status: 200 len: 1273 microversion: 2.1 time: 0.361617 May 27 03:41:02.657895 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 12/24] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:02 2021] GET /compute/v2.1/servers/5d5fdc92-2d08-4ae1-a508-032e39ce0958 => generated 1273 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:02.695408 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-c46112e1-1ef2-42d6-9a39-56c87e8cbc4e tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:02.696308 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-c46112e1-1ef2-42d6-9a39-56c87e8cbc4e tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 695616b8-9b90-4e8d-b719-de3eabe09cbe] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:02.717185 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c46112e1-1ef2-42d6-9a39-56c87e8cbc4e tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:02.718059 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c46112e1-1ef2-42d6-9a39-56c87e8cbc4e tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:02.720030 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c46112e1-1ef2-42d6-9a39-56c87e8cbc4e tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:02.722382 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c46112e1-1ef2-42d6-9a39-56c87e8cbc4e tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:03.048014 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-c46112e1-1ef2-42d6-9a39-56c87e8cbc4e tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:03.062100 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-c46112e1-1ef2-42d6-9a39-56c87e8cbc4e tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/695616b8-9b90-4e8d-b719-de3eabe09cbe" status: 200 len: 1276 microversion: 2.1 time: 0.368024 May 27 03:41:03.075483 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 13/25] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:02 2021] GET /compute/v2.1/servers/695616b8-9b90-4e8d-b719-de3eabe09cbe => generated 1276 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:03.675314 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-90b3cf7d-2643-4b50-bea1-0c47b9d4a07d tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:03.676013 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-90b3cf7d-2643-4b50-bea1-0c47b9d4a07d tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] [instance: 5d5fdc92-2d08-4ae1-a508-032e39ce0958] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:03.692257 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-90b3cf7d-2643-4b50-bea1-0c47b9d4a07d tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:03.692732 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-90b3cf7d-2643-4b50-bea1-0c47b9d4a07d tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:03.696203 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-90b3cf7d-2643-4b50-bea1-0c47b9d4a07d tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:03.696709 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-90b3cf7d-2643-4b50-bea1-0c47b9d4a07d tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:03.910988 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-90b3cf7d-2643-4b50-bea1-0c47b9d4a07d tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0207569193c64a2abbb1ae8f857d41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f220b161db454279a529469cc181cb86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:03.933909 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-90b3cf7d-2643-4b50-bea1-0c47b9d4a07d tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] 10.222.0.25 "GET /compute/v2.1/servers/5d5fdc92-2d08-4ae1-a508-032e39ce0958" status: 200 len: 1273 microversion: 2.1 time: 0.260900 May 27 03:41:03.935381 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 13/26] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:03 2021] GET /compute/v2.1/servers/5d5fdc92-2d08-4ae1-a508-032e39ce0958 => generated 1273 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:04.083905 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-aa1b168e-e62c-42a0-b038-1039d0c363bf tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:04.084478 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-aa1b168e-e62c-42a0-b038-1039d0c363bf tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 695616b8-9b90-4e8d-b719-de3eabe09cbe] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:04.095742 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-aa1b168e-e62c-42a0-b038-1039d0c363bf tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:04.096198 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-aa1b168e-e62c-42a0-b038-1039d0c363bf tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:04.097030 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-aa1b168e-e62c-42a0-b038-1039d0c363bf tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:04.097455 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-aa1b168e-e62c-42a0-b038-1039d0c363bf tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:04.336052 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-aa1b168e-e62c-42a0-b038-1039d0c363bf tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:04.353468 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-aa1b168e-e62c-42a0-b038-1039d0c363bf tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/695616b8-9b90-4e8d-b719-de3eabe09cbe" status: 200 len: 1276 microversion: 2.1 time: 0.272791 May 27 03:41:04.356617 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 14/27] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:04 2021] GET /compute/v2.1/servers/695616b8-9b90-4e8d-b719-de3eabe09cbe => generated 1276 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:04.952491 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-e69950bd-96eb-4ab7-872a-80d1bf4c0d4d tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:04.956120 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-e69950bd-96eb-4ab7-872a-80d1bf4c0d4d tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] [instance: 5d5fdc92-2d08-4ae1-a508-032e39ce0958] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:04.978670 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e69950bd-96eb-4ab7-872a-80d1bf4c0d4d tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:04.979351 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e69950bd-96eb-4ab7-872a-80d1bf4c0d4d tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:04.982848 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e69950bd-96eb-4ab7-872a-80d1bf4c0d4d tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:04.984812 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e69950bd-96eb-4ab7-872a-80d1bf4c0d4d tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:05.372620 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-9a164ba9-78f1-43d4-9fdf-9a351b179df5 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:05.373252 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-9a164ba9-78f1-43d4-9fdf-9a351b179df5 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 695616b8-9b90-4e8d-b719-de3eabe09cbe] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:05.391055 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-9a164ba9-78f1-43d4-9fdf-9a351b179df5 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:05.408611 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-9a164ba9-78f1-43d4-9fdf-9a351b179df5 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:05.409832 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-9a164ba9-78f1-43d4-9fdf-9a351b179df5 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:05.413355 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-9a164ba9-78f1-43d4-9fdf-9a351b179df5 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:05.711559 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-e69950bd-96eb-4ab7-872a-80d1bf4c0d4d tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0207569193c64a2abbb1ae8f857d41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f220b161db454279a529469cc181cb86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:05.723694 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-e69950bd-96eb-4ab7-872a-80d1bf4c0d4d tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] 10.222.0.25 "GET /compute/v2.1/servers/5d5fdc92-2d08-4ae1-a508-032e39ce0958" status: 200 len: 1273 microversion: 2.1 time: 0.775784 May 27 03:41:05.746585 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 14/28] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:04 2021] GET /compute/v2.1/servers/5d5fdc92-2d08-4ae1-a508-032e39ce0958 => generated 1273 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:06.193337 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-9a164ba9-78f1-43d4-9fdf-9a351b179df5 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:06.203489 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-9a164ba9-78f1-43d4-9fdf-9a351b179df5 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/695616b8-9b90-4e8d-b719-de3eabe09cbe" status: 200 len: 1276 microversion: 2.1 time: 0.834602 May 27 03:41:06.206308 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 15/29] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:05 2021] GET /compute/v2.1/servers/695616b8-9b90-4e8d-b719-de3eabe09cbe => generated 1276 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:41:06.748162 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-106119b8-206a-4cbb-b6a1-46c6899db0d6 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:06.754378 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-106119b8-206a-4cbb-b6a1-46c6899db0d6 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] [instance: 5d5fdc92-2d08-4ae1-a508-032e39ce0958] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:06.789135 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-106119b8-206a-4cbb-b6a1-46c6899db0d6 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:06.793271 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-106119b8-206a-4cbb-b6a1-46c6899db0d6 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:06.795885 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-106119b8-206a-4cbb-b6a1-46c6899db0d6 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:06.799849 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-106119b8-206a-4cbb-b6a1-46c6899db0d6 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:07.614436 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-128fe236-3a97-47b3-b946-fcf1cee7c31b tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'create', calling method: .version_select at 0x7f9889c64d30>, body: {"keypair": {"name": "tempest-keypair-1730242496"}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:41:07.718755 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.quota [None req-128fe236-3a97-47b3-b946-fcf1cee7c31b tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Getting quotas for project 276e81e3da1f4d4c9c1881d1b1e863c4. Resources: {'key_pairs'} {{(pid=113020) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 27 03:41:07.726466 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.quota [None req-128fe236-3a97-47b3-b946-fcf1cee7c31b tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Getting quotas for user 9c1aa1f7c98f42c5a047354bef07b355 and project 276e81e3da1f4d4c9c1881d1b1e863c4. Resources: {'key_pairs'} {{(pid=113020) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 27 03:41:08.126887 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-106119b8-206a-4cbb-b6a1-46c6899db0d6 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0207569193c64a2abbb1ae8f857d41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f220b161db454279a529469cc181cb86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:08.149041 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-106119b8-206a-4cbb-b6a1-46c6899db0d6 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] 10.222.0.25 "GET /compute/v2.1/servers/5d5fdc92-2d08-4ae1-a508-032e39ce0958" status: 200 len: 1273 microversion: 2.1 time: 1.409415 May 27 03:41:08.150012 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 16/30] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:06 2021] GET /compute/v2.1/servers/5d5fdc92-2d08-4ae1-a508-032e39ce0958 => generated 1273 bytes in 1412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:08.158270 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-09605b98-f62c-45f4-be5e-7de561dffda7 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:08.159407 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-09605b98-f62c-45f4-be5e-7de561dffda7 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 695616b8-9b90-4e8d-b719-de3eabe09cbe] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:08.178177 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-09605b98-f62c-45f4-be5e-7de561dffda7 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:08.179079 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-09605b98-f62c-45f4-be5e-7de561dffda7 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:08.181344 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-09605b98-f62c-45f4-be5e-7de561dffda7 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:08.184604 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-09605b98-f62c-45f4-be5e-7de561dffda7 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:08.220742 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.quota [None req-128fe236-3a97-47b3-b946-fcf1cee7c31b tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Getting quotas for project 276e81e3da1f4d4c9c1881d1b1e863c4. Resources: {'key_pairs'} {{(pid=113020) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 27 03:41:08.234470 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.quota [None req-128fe236-3a97-47b3-b946-fcf1cee7c31b tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Getting quotas for user 9c1aa1f7c98f42c5a047354bef07b355 and project 276e81e3da1f4d4c9c1881d1b1e863c4. Resources: {'key_pairs'} {{(pid=113020) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 27 03:41:08.299986 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-128fe236-3a97-47b3-b946-fcf1cee7c31b tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 1.566766 May 27 03:41:08.315397 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 15/31] 10.222.0.25 () {60 vars in 1158 bytes} [Thu May 27 03:41:06 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 1583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:09.166536 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-2f689612-4b4c-49df-bfa8-455844bc18fa tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:09.167179 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-2f689612-4b4c-49df-bfa8-455844bc18fa tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] [instance: 5d5fdc92-2d08-4ae1-a508-032e39ce0958] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:09.190920 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-2f689612-4b4c-49df-bfa8-455844bc18fa tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:09.191499 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-2f689612-4b4c-49df-bfa8-455844bc18fa tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:09.192351 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-2f689612-4b4c-49df-bfa8-455844bc18fa tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:09.195906 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-2f689612-4b4c-49df-bfa8-455844bc18fa tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:09.872438 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-09605b98-f62c-45f4-be5e-7de561dffda7 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:09.891437 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-09605b98-f62c-45f4-be5e-7de561dffda7 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/695616b8-9b90-4e8d-b719-de3eabe09cbe" status: 200 len: 1318 microversion: 2.1 time: 1.739916 May 27 03:41:09.907124 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 17/32] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:08 2021] GET /compute/v2.1/servers/695616b8-9b90-4e8d-b719-de3eabe09cbe => generated 1318 bytes in 1756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:10.197494 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-4f8645ed-924d-45ba-9357-098d7c120bd0 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'create', calling method: .version_select at 0x7f9889335e50>, body: {"keypair": {"name": "tempest-keypair-904272356"}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:41:10.270297 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.quota [None req-4f8645ed-924d-45ba-9357-098d7c120bd0 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Getting quotas for project 16ccb2756adb4055942bd0a0f0a061f4. Resources: {'key_pairs'} {{(pid=113021) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 27 03:41:10.277445 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.quota [None req-4f8645ed-924d-45ba-9357-098d7c120bd0 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Getting quotas for user e44e0bf02c8a48b1a5bbbfd71f2281bb and project 16ccb2756adb4055942bd0a0f0a061f4. Resources: {'key_pairs'} {{(pid=113021) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 27 03:41:10.975774 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-2f689612-4b4c-49df-bfa8-455844bc18fa tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0207569193c64a2abbb1ae8f857d41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f220b161db454279a529469cc181cb86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:10.989111 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-2f689612-4b4c-49df-bfa8-455844bc18fa tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] 10.222.0.25 "GET /compute/v2.1/servers/5d5fdc92-2d08-4ae1-a508-032e39ce0958" status: 200 len: 1315 microversion: 2.1 time: 1.825113 May 27 03:41:10.992895 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 16/33] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:09 2021] GET /compute/v2.1/servers/5d5fdc92-2d08-4ae1-a508-032e39ce0958 => generated 1315 bytes in 1828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:10.999859 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-9de1620a-cb4c-4f59-b909-d960e326daed tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:11.002328 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-9de1620a-cb4c-4f59-b909-d960e326daed tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 695616b8-9b90-4e8d-b719-de3eabe09cbe] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:11.019730 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9de1620a-cb4c-4f59-b909-d960e326daed tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:11.024190 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9de1620a-cb4c-4f59-b909-d960e326daed tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:11.024190 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9de1620a-cb4c-4f59-b909-d960e326daed tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:11.024190 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9de1620a-cb4c-4f59-b909-d960e326daed tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:11.297270 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.quota [None req-4f8645ed-924d-45ba-9357-098d7c120bd0 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Getting quotas for project 16ccb2756adb4055942bd0a0f0a061f4. Resources: {'key_pairs'} {{(pid=113021) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 27 03:41:11.305552 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.quota [None req-4f8645ed-924d-45ba-9357-098d7c120bd0 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Getting quotas for user e44e0bf02c8a48b1a5bbbfd71f2281bb and project 16ccb2756adb4055942bd0a0f0a061f4. Resources: {'key_pairs'} {{(pid=113021) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 27 03:41:11.346385 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-4f8645ed-924d-45ba-9357-098d7c120bd0 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 1.432984 May 27 03:41:11.346385 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 18/34] 10.222.0.25 () {62 vars in 1199 bytes} [Thu May 27 03:41:09 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 1435 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) May 27 03:41:12.006370 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-138cd639-f241-4dd0-94b1-9d20b8d2d512 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:12.008977 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-138cd639-f241-4dd0-94b1-9d20b8d2d512 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] [instance: 5d5fdc92-2d08-4ae1-a508-032e39ce0958] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:12.026023 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-138cd639-f241-4dd0-94b1-9d20b8d2d512 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:12.026515 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-138cd639-f241-4dd0-94b1-9d20b8d2d512 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:12.027351 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-138cd639-f241-4dd0-94b1-9d20b8d2d512 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:12.027989 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-138cd639-f241-4dd0-94b1-9d20b8d2d512 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:12.296275 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-9de1620a-cb4c-4f59-b909-d960e326daed tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:12.315436 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-9de1620a-cb4c-4f59-b909-d960e326daed tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/695616b8-9b90-4e8d-b719-de3eabe09cbe" status: 200 len: 1318 microversion: 2.1 time: 1.321843 May 27 03:41:12.319534 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 17/35] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:10 2021] GET /compute/v2.1/servers/695616b8-9b90-4e8d-b719-de3eabe09cbe => generated 1318 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:13.302291 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-138cd639-f241-4dd0-94b1-9d20b8d2d512 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0207569193c64a2abbb1ae8f857d41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f220b161db454279a529469cc181cb86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:13.335063 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-605a4b46-fbd5-4182-9809-440bc16a320a tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:13.336333 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-605a4b46-fbd5-4182-9809-440bc16a320a tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 695616b8-9b90-4e8d-b719-de3eabe09cbe] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:13.339626 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-138cd639-f241-4dd0-94b1-9d20b8d2d512 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] 10.222.0.25 "GET /compute/v2.1/servers/5d5fdc92-2d08-4ae1-a508-032e39ce0958" status: 200 len: 1315 microversion: 2.1 time: 1.328954 May 27 03:41:13.346558 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 19/36] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:12 2021] GET /compute/v2.1/servers/5d5fdc92-2d08-4ae1-a508-032e39ce0958 => generated 1315 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:41:13.351807 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-605a4b46-fbd5-4182-9809-440bc16a320a tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:13.352273 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-605a4b46-fbd5-4182-9809-440bc16a320a tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:13.353104 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-605a4b46-fbd5-4182-9809-440bc16a320a tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:13.353535 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-605a4b46-fbd5-4182-9809-440bc16a320a tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:14.097015 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-6e417549-cc53-4cd4-906e-5f40db24fefb tempest-VolumesNegativeTest-1100035288 tempest-VolumesNegativeTest-1100035288-project] Action: 'create', calling method: .version_select at 0x7f98892fa700>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1012851580", "metadata": {"Type": "work"}}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:41:14.105093 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-6e417549-cc53-4cd4-906e-5f40db24fefb tempest-VolumesNegativeTest-1100035288 tempest-VolumesNegativeTest-1100035288-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=113021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 27 03:41:14.106948 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-6e417549-cc53-4cd4-906e-5f40db24fefb tempest-VolumesNegativeTest-1100035288 tempest-VolumesNegativeTest-1100035288-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.331199 May 27 03:41:14.107812 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 20/37] 10.222.0.25 () {60 vars in 1156 bytes} [Thu May 27 03:41:13 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 333 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 03:41:14.121928 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-d42ecbeb-0863-4acd-b206-19cd8f9ddbb6 tempest-VolumesNegativeTest-1100035288 tempest-VolumesNegativeTest-1100035288-project] Action: 'create', calling method: .version_select at 0x7f9889236940>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1848392353", "metadata": {"Type": "work"}}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:41:14.123328 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-d42ecbeb-0863-4acd-b206-19cd8f9ddbb6 tempest-VolumesNegativeTest-1100035288 tempest-VolumesNegativeTest-1100035288-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=113021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 27 03:41:14.127259 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-d42ecbeb-0863-4acd-b206-19cd8f9ddbb6 tempest-VolumesNegativeTest-1100035288 tempest-VolumesNegativeTest-1100035288-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010479 May 27 03:41:14.130640 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 21/38] 10.222.0.25 () {60 vars in 1156 bytes} [Thu May 27 03:41:14 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 27 03:41:14.165839 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-2e8df07f-e879-452e-b1ee-36f06b8a1ba5 tempest-VolumesNegativeTest-1100035288 tempest-VolumesNegativeTest-1100035288-project] Action: 'create', calling method: .version_select at 0x7f988938f820>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-770302853", "metadata": {"Type": "work"}}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:41:14.170462 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-2e8df07f-e879-452e-b1ee-36f06b8a1ba5 tempest-VolumesNegativeTest-1100035288 tempest-VolumesNegativeTest-1100035288-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=113021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 27 03:41:14.177318 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-2e8df07f-e879-452e-b1ee-36f06b8a1ba5 tempest-VolumesNegativeTest-1100035288 tempest-VolumesNegativeTest-1100035288-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.030651 May 27 03:41:14.181706 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 22/39] 10.222.0.25 () {60 vars in 1156 bytes} [Thu May 27 03:41:14 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 03:41:14.205428 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-2e595611-3c08-47dd-b815-d5087b44a07d tempest-VolumesNegativeTest-1100035288 tempest-VolumesNegativeTest-1100035288-project] Calling method '.version_select at 0x7f98893171f0>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:14.461080 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.wsgi [None req-2e595611-3c08-47dd-b815-d5087b44a07d tempest-VolumesNegativeTest-1100035288 tempest-VolumesNegativeTest-1100035288-project] HTTP exception thrown: Volume tempest-invalid-155806301 could not be found. May 27 03:41:14.461744 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-2e595611-3c08-47dd-b815-d5087b44a07d tempest-VolumesNegativeTest-1100035288 tempest-VolumesNegativeTest-1100035288-project] Returning 404 to user: Volume tempest-invalid-155806301 could not be found. {{(pid=113021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 27 03:41:14.463877 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-2e595611-3c08-47dd-b815-d5087b44a07d tempest-VolumesNegativeTest-1100035288 tempest-VolumesNegativeTest-1100035288-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/tempest-invalid-155806301" status: 404 len: 98 microversion: 2.1 time: 0.272242 May 27 03:41:14.464522 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 23/40] 10.222.0.25 () {58 vars in 1215 bytes} [Thu May 27 03:41:14 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-155806301 => generated 98 bytes in 276 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 27 03:41:14.583126 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-605a4b46-fbd5-4182-9809-440bc16a320a tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:14.611459 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-605a4b46-fbd5-4182-9809-440bc16a320a tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/695616b8-9b90-4e8d-b719-de3eabe09cbe" status: 200 len: 1318 microversion: 2.1 time: 1.277929 May 27 03:41:14.617359 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 18/41] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:13 2021] GET /compute/v2.1/servers/695616b8-9b90-4e8d-b719-de3eabe09cbe => generated 1318 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:41:14.632882 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-168cc22c-c487-4d96-aef2-5a88f1c637ab tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:14.637145 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-168cc22c-c487-4d96-aef2-5a88f1c637ab tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] [instance: 5d5fdc92-2d08-4ae1-a508-032e39ce0958] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:14.650519 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [req-aa92b7bf-d0ca-4e60-925f-aa0dc0299c56 req-4d47feff-ef4f-44ad-9225-dc5ba0c7907c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d5fdc92-2d08-4ae1-a508-032e39ce0958", "tag": "1bbb12ef-9a7a-4069-a54e-b707ce9a6809"}]} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:41:14.653270 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:41:14.653270 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: warnings.warn(msg) May 27 03:41:14.657774 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-168cc22c-c487-4d96-aef2-5a88f1c637ab tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:14.661009 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-168cc22c-c487-4d96-aef2-5a88f1c637ab tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:14.662014 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-168cc22c-c487-4d96-aef2-5a88f1c637ab tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:14.665026 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-168cc22c-c487-4d96-aef2-5a88f1c637ab tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:14.705021 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-aa92b7bf-d0ca-4e60-925f-aa0dc0299c56 req-4d47feff-ef4f-44ad-9225-dc5ba0c7907c service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:14.705530 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-aa92b7bf-d0ca-4e60-925f-aa0dc0299c56 req-4d47feff-ef4f-44ad-9225-dc5ba0c7907c service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:14.748578 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.compute.server_external_events [req-aa92b7bf-d0ca-4e60-925f-aa0dc0299c56 req-4d47feff-ef4f-44ad-9225-dc5ba0c7907c service nova] Creating event network-changed:1bbb12ef-9a7a-4069-a54e-b707ce9a6809 for instance 5d5fdc92-2d08-4ae1-a508-032e39ce0958 on hv-cinder-79326 May 27 03:41:14.749335 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-aa92b7bf-d0ca-4e60-925f-aa0dc0299c56 req-4d47feff-ef4f-44ad-9225-dc5ba0c7907c service nova] Acquired lock "compute-rpcapi-router" {{(pid=113021) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} May 27 03:41:14.750683 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-3e3d31bc-3755-473b-94e0-eba097c268a8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:14.751853 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-3e3d31bc-3755-473b-94e0-eba097c268a8 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:14.753105 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-3e3d31bc-3755-473b-94e0-eba097c268a8 None None] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:14.753737 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-3e3d31bc-3755-473b-94e0-eba097c268a8 None None] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:14.764972 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.compute.rpcapi [None req-3e3d31bc-3755-473b-94e0-eba097c268a8 None None] Automatically selected compute RPC version 6.0 from minimum service version 56 May 27 03:41:14.766218 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-3e3d31bc-3755-473b-94e0-eba097c268a8 None None] Releasing lock "compute-rpcapi-router" {{(pid=113021) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} May 27 03:41:14.861996 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-3e3d31bc-3755-473b-94e0-eba097c268a8 None None] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.395655 May 27 03:41:14.862920 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 24/42] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:41:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:41:14.868228 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-2274b851-649b-43aa-8d23-039dd1262c42 tempest-VolumesNegativeTest-1100035288 tempest-VolumesNegativeTest-1100035288-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003906 May 27 03:41:14.870377 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 25/43] 10.222.0.25 () {58 vars in 1140 bytes} [Thu May 27 03:41:14 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 27 03:41:14.884864 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-d3f995a3-64e1-4755-bee6-51950d116a49 tempest-VolumesNegativeTest-1100035288 tempest-VolumesNegativeTest-1100035288-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007940 May 27 03:41:14.886952 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 26/44] 10.222.0.25 () {58 vars in 1137 bytes} [Thu May 27 03:41:14 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 27 03:41:14.908555 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-394811be-e6ab-4c3b-892d-5d6fd356a731 tempest-VolumesNegativeTest-1100035288 tempest-VolumesNegativeTest-1100035288-project] Calling method '.version_select at 0x7f98892fa160>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:15.059225 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.wsgi [None req-394811be-e6ab-4c3b-892d-5d6fd356a731 tempest-VolumesNegativeTest-1100035288 tempest-VolumesNegativeTest-1100035288-project] HTTP exception thrown: Volume e00de0fa-af74-41c8-961f-6b2bac2a6c02 could not be found. May 27 03:41:15.060316 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-394811be-e6ab-4c3b-892d-5d6fd356a731 tempest-VolumesNegativeTest-1100035288 tempest-VolumesNegativeTest-1100035288-project] Returning 404 to user: Volume e00de0fa-af74-41c8-961f-6b2bac2a6c02 could not be found. {{(pid=113021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 27 03:41:15.062530 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-394811be-e6ab-4c3b-892d-5d6fd356a731 tempest-VolumesNegativeTest-1100035288 tempest-VolumesNegativeTest-1100035288-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/e00de0fa-af74-41c8-961f-6b2bac2a6c02" status: 404 len: 109 microversion: 2.1 time: 0.169227 May 27 03:41:15.067984 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 27/45] 10.222.0.25 () {58 vars in 1248 bytes} [Thu May 27 03:41:14 2021] DELETE /compute/v2.1/os-volumes/e00de0fa-af74-41c8-961f-6b2bac2a6c02 => generated 109 bytes in 173 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:41:15.075543 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-d56d5bd2-b594-4fae-9e85-9ca626a255a0 tempest-VolumesNegativeTest-1100035288 tempest-VolumesNegativeTest-1100035288-project] Calling method '.version_select at 0x7f9889335820>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:15.264958 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.wsgi [None req-d56d5bd2-b594-4fae-9e85-9ca626a255a0 tempest-VolumesNegativeTest-1100035288 tempest-VolumesNegativeTest-1100035288-project] HTTP exception thrown: Volume aa332073-8168-46bb-8b5f-817661d13832 could not be found. May 27 03:41:15.265693 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-d56d5bd2-b594-4fae-9e85-9ca626a255a0 tempest-VolumesNegativeTest-1100035288 tempest-VolumesNegativeTest-1100035288-project] Returning 404 to user: Volume aa332073-8168-46bb-8b5f-817661d13832 could not be found. {{(pid=113021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 27 03:41:15.275436 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-d56d5bd2-b594-4fae-9e85-9ca626a255a0 tempest-VolumesNegativeTest-1100035288 tempest-VolumesNegativeTest-1100035288-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/aa332073-8168-46bb-8b5f-817661d13832" status: 404 len: 109 microversion: 2.1 time: 0.196921 May 27 03:41:15.275436 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 28/46] 10.222.0.25 () {58 vars in 1245 bytes} [Thu May 27 03:41:15 2021] GET /compute/v2.1/os-volumes/aa332073-8168-46bb-8b5f-817661d13832 => generated 109 bytes in 202 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:41:15.631306 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-88974cfd-2c65-4053-8f97-978223254adc tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:15.633306 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-88974cfd-2c65-4053-8f97-978223254adc tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 695616b8-9b90-4e8d-b719-de3eabe09cbe] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:15.662891 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-88974cfd-2c65-4053-8f97-978223254adc tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:15.663355 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-88974cfd-2c65-4053-8f97-978223254adc tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:15.673310 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-88974cfd-2c65-4053-8f97-978223254adc tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:15.674034 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-88974cfd-2c65-4053-8f97-978223254adc tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:15.674568 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-168cc22c-c487-4d96-aef2-5a88f1c637ab tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0207569193c64a2abbb1ae8f857d41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f220b161db454279a529469cc181cb86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:15.688095 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-168cc22c-c487-4d96-aef2-5a88f1c637ab tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] 10.222.0.25 "GET /compute/v2.1/servers/5d5fdc92-2d08-4ae1-a508-032e39ce0958" status: 200 len: 1315 microversion: 2.1 time: 1.069144 May 27 03:41:15.696695 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 19/47] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:14 2021] GET /compute/v2.1/servers/5d5fdc92-2d08-4ae1-a508-032e39ce0958 => generated 1315 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:16.270035 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-88974cfd-2c65-4053-8f97-978223254adc tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:16.279651 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-88974cfd-2c65-4053-8f97-978223254adc tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/695616b8-9b90-4e8d-b719-de3eabe09cbe" status: 200 len: 1318 microversion: 2.1 time: 0.651778 May 27 03:41:16.289712 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 29/48] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:15 2021] GET /compute/v2.1/servers/695616b8-9b90-4e8d-b719-de3eabe09cbe => generated 1318 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:41:16.706470 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-0326790e-0a4f-4407-b5c7-cb78a8788cc2 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:16.707224 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-0326790e-0a4f-4407-b5c7-cb78a8788cc2 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] [instance: 5d5fdc92-2d08-4ae1-a508-032e39ce0958] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:16.730283 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0326790e-0a4f-4407-b5c7-cb78a8788cc2 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:16.730982 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0326790e-0a4f-4407-b5c7-cb78a8788cc2 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:16.734440 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0326790e-0a4f-4407-b5c7-cb78a8788cc2 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:16.735274 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0326790e-0a4f-4407-b5c7-cb78a8788cc2 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:17.215024 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [req-97309771-b906-4233-bc26-ab6951ad1850 req-3d51e4a4-6827-4330-ac6f-731bf1fe8d80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "695616b8-9b90-4e8d-b719-de3eabe09cbe", "tag": "1279817e-ea8d-4755-966e-3691e51297b7"}]} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:41:17.217893 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:41:17.217893 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: warnings.warn(msg) May 27 03:41:17.253152 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-97309771-b906-4233-bc26-ab6951ad1850 req-3d51e4a4-6827-4330-ac6f-731bf1fe8d80 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:17.254536 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-97309771-b906-4233-bc26-ab6951ad1850 req-3d51e4a4-6827-4330-ac6f-731bf1fe8d80 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:17.325370 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.compute.server_external_events [req-97309771-b906-4233-bc26-ab6951ad1850 req-3d51e4a4-6827-4330-ac6f-731bf1fe8d80 service nova] Creating event network-changed:1279817e-ea8d-4755-966e-3691e51297b7 for instance 695616b8-9b90-4e8d-b719-de3eabe09cbe on hv-cinder-79326 May 27 03:41:17.335808 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [req-97309771-b906-4233-bc26-ab6951ad1850 req-3d51e4a4-6827-4330-ac6f-731bf1fe8d80 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127223 May 27 03:41:17.339549 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 30/49] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:41:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:41:17.363405 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-11a2a416-3f42-44f8-948b-bdb6fa45431b tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:17.365337 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-11a2a416-3f42-44f8-948b-bdb6fa45431b tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 695616b8-9b90-4e8d-b719-de3eabe09cbe] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:17.396651 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-11a2a416-3f42-44f8-948b-bdb6fa45431b tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:17.397775 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-11a2a416-3f42-44f8-948b-bdb6fa45431b tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:17.399649 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-11a2a416-3f42-44f8-948b-bdb6fa45431b tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:17.401568 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-11a2a416-3f42-44f8-948b-bdb6fa45431b tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:17.859166 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-0326790e-0a4f-4407-b5c7-cb78a8788cc2 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0207569193c64a2abbb1ae8f857d41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f220b161db454279a529469cc181cb86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:17.877392 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-0326790e-0a4f-4407-b5c7-cb78a8788cc2 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] 10.222.0.25 "GET /compute/v2.1/servers/5d5fdc92-2d08-4ae1-a508-032e39ce0958" status: 200 len: 1315 microversion: 2.1 time: 1.175490 May 27 03:41:17.878235 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 20/50] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:16 2021] GET /compute/v2.1/servers/5d5fdc92-2d08-4ae1-a508-032e39ce0958 => generated 1315 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:18.456530 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-11a2a416-3f42-44f8-948b-bdb6fa45431b tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:18.471679 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-11a2a416-3f42-44f8-948b-bdb6fa45431b tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/695616b8-9b90-4e8d-b719-de3eabe09cbe" status: 200 len: 1318 microversion: 2.1 time: 1.126123 May 27 03:41:18.472879 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 31/51] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:17 2021] GET /compute/v2.1/servers/695616b8-9b90-4e8d-b719-de3eabe09cbe => generated 1318 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:18.895391 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-f1149167-e154-4eb2-8888-caedc263abff tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:18.896033 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-f1149167-e154-4eb2-8888-caedc263abff tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] [instance: 5d5fdc92-2d08-4ae1-a508-032e39ce0958] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:18.912039 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f1149167-e154-4eb2-8888-caedc263abff tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:18.912537 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f1149167-e154-4eb2-8888-caedc263abff tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:18.917610 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f1149167-e154-4eb2-8888-caedc263abff tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:18.917610 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f1149167-e154-4eb2-8888-caedc263abff tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:19.485951 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-7d4abc80-5785-461f-b0ea-f43a4a4bf70a tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2013782786", "imageRef": "78c0913d-0e41-4b41-b38f-f45c4f2535ff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b35bcef9-7d04-408a-b003-58c7e5878e65"}]}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:41:19.595791 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.network.neutron [None req-7d4abc80-5785-461f-b0ea-f43a4a4bf70a tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] validate_networks() for [('b35bcef9-7d04-408a-b003-58c7e5878e65', None, None, None)] {{(pid=113021) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 27 03:41:19.751271 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-f1149167-e154-4eb2-8888-caedc263abff tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0207569193c64a2abbb1ae8f857d41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f220b161db454279a529469cc181cb86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:19.798755 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-f1149167-e154-4eb2-8888-caedc263abff tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] 10.222.0.25 "GET /compute/v2.1/servers/5d5fdc92-2d08-4ae1-a508-032e39ce0958" status: 200 len: 1315 microversion: 2.1 time: 0.908595 May 27 03:41:19.817893 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 21/52] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:18 2021] GET /compute/v2.1/servers/5d5fdc92-2d08-4ae1-a508-032e39ce0958 => generated 1315 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:19.841033 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-00cf4cce-2b81-4dd2-9d67-2d9c74016412 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:19.841885 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-00cf4cce-2b81-4dd2-9d67-2d9c74016412 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 695616b8-9b90-4e8d-b719-de3eabe09cbe] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:19.853885 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-00cf4cce-2b81-4dd2-9d67-2d9c74016412 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:19.859313 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-00cf4cce-2b81-4dd2-9d67-2d9c74016412 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:19.860588 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-00cf4cce-2b81-4dd2-9d67-2d9c74016412 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:19.861250 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-00cf4cce-2b81-4dd2-9d67-2d9c74016412 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:20.392476 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-00cf4cce-2b81-4dd2-9d67-2d9c74016412 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:20.435588 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-00cf4cce-2b81-4dd2-9d67-2d9c74016412 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/695616b8-9b90-4e8d-b719-de3eabe09cbe" status: 200 len: 1318 microversion: 2.1 time: 0.613121 May 27 03:41:20.436793 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 22/53] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:19 2021] GET /compute/v2.1/servers/695616b8-9b90-4e8d-b719-de3eabe09cbe => generated 1318 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:20.450786 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-cd1cfc40-8ce3-426e-b39e-039c90296f5e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1732438390", "imageRef": "78c0913d-0e41-4b41-b38f-f45c4f2535ff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "130ff3ea-d273-4d90-8f0d-494d41441c60"}], "security_groups": [{"name": "tempest-securitygroup--901761077"}], "key_name": "tempest-keypair-1730242496", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:41:20.851130 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.network.neutron [None req-cd1cfc40-8ce3-426e-b39e-039c90296f5e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] validate_networks() for [('130ff3ea-d273-4d90-8f0d-494d41441c60', None, None, None)] {{(pid=113020) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 27 03:41:21.070446 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.virt.hardware [None req-7d4abc80-5785-461f-b0ea-f43a4a4bf70a tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Flavor limits 0:0:0 {{(pid=113021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 27 03:41:21.070925 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.virt.hardware [None req-7d4abc80-5785-461f-b0ea-f43a4a4bf70a tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Image limits 0:0:0 {{(pid=113021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 27 03:41:21.071347 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.virt.hardware [None req-7d4abc80-5785-461f-b0ea-f43a4a4bf70a tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Flavor pref 0:0:0 {{(pid=113021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 27 03:41:21.071760 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.virt.hardware [None req-7d4abc80-5785-461f-b0ea-f43a4a4bf70a tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Image pref 0:0:0 {{(pid=113021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 27 03:41:21.072189 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.virt.hardware [None req-7d4abc80-5785-461f-b0ea-f43a4a4bf70a tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=113021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 27 03:41:21.084313 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-7d4abc80-5785-461f-b0ea-f43a4a4bf70a tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:21.084800 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-7d4abc80-5785-461f-b0ea-f43a4a4bf70a tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:21.085604 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-7d4abc80-5785-461f-b0ea-f43a4a4bf70a tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:21.086050 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-7d4abc80-5785-461f-b0ea-f43a4a4bf70a tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:21.121368 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.quota [None req-7d4abc80-5785-461f-b0ea-f43a4a4bf70a tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Getting quotas for project fa24b9f82e13448382e6b5f6bd699fab. Resources: {'instances', 'cores', 'ram'} {{(pid=113021) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 27 03:41:21.121844 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.quota [None req-7d4abc80-5785-461f-b0ea-f43a4a4bf70a tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Getting quotas for user 806656c3c07441d98bf4bf9e10c0296d and project fa24b9f82e13448382e6b5f6bd699fab. Resources: {'instances', 'cores', 'ram'} {{(pid=113021) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 27 03:41:21.133685 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-7d4abc80-5785-461f-b0ea-f43a4a4bf70a tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Going to run 1 instances... {{(pid=113021) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 27 03:41:21.136859 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-7d4abc80-5785-461f-b0ea-f43a4a4bf70a tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78c0913d-0e41-4b41-b38f-f45c4f2535ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=113021) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 27 03:41:21.284094 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-7d4abc80-5785-461f-b0ea-f43a4a4bf70a tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.292501 May 27 03:41:21.285424 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 32/54] 10.222.0.25 () {60 vars in 1147 bytes} [Thu May 27 03:41:18 2021] POST /compute/v2.1/servers => generated 383 bytes in 2295 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 03:41:21.295241 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-db351097-dee8-432d-af1b-02fd39151516 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:21.296166 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-db351097-dee8-432d-af1b-02fd39151516 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] [instance: 5d5fdc92-2d08-4ae1-a508-032e39ce0958] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:21.305451 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-db351097-dee8-432d-af1b-02fd39151516 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:21.306146 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-db351097-dee8-432d-af1b-02fd39151516 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:21.307066 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-db351097-dee8-432d-af1b-02fd39151516 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:21.307794 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-db351097-dee8-432d-af1b-02fd39151516 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:21.616572 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-db351097-dee8-432d-af1b-02fd39151516 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0207569193c64a2abbb1ae8f857d41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f220b161db454279a529469cc181cb86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:21.625110 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-db351097-dee8-432d-af1b-02fd39151516 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] 10.222.0.25 "GET /compute/v2.1/servers/5d5fdc92-2d08-4ae1-a508-032e39ce0958" status: 200 len: 1315 microversion: 2.1 time: 0.338361 May 27 03:41:21.629608 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 33/55] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:21 2021] GET /compute/v2.1/servers/5d5fdc92-2d08-4ae1-a508-032e39ce0958 => generated 1315 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:21.641134 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-06dcbc62-c5bf-49ba-ac44-c4c8b3470792 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2107085963", "imageRef": "78c0913d-0e41-4b41-b38f-f45c4f2535ff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f65a0cca-1ebc-4ae6-b01b-5fdf0f05198a"}], "security_groups": [{"name": "tempest-securitygroup--812930336"}], "key_name": "tempest-keypair-904272356", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:41:21.842291 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.network.neutron [None req-06dcbc62-c5bf-49ba-ac44-c4c8b3470792 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] validate_networks() for [('f65a0cca-1ebc-4ae6-b01b-5fdf0f05198a', None, None, None)] {{(pid=113021) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 27 03:41:22.417594 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.virt.hardware [None req-cd1cfc40-8ce3-426e-b39e-039c90296f5e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Flavor limits 0:0:0 {{(pid=113020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 27 03:41:22.418138 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.virt.hardware [None req-cd1cfc40-8ce3-426e-b39e-039c90296f5e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Image limits 0:0:0 {{(pid=113020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 27 03:41:22.418995 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.virt.hardware [None req-cd1cfc40-8ce3-426e-b39e-039c90296f5e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Flavor pref 0:0:0 {{(pid=113020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 27 03:41:22.419668 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.virt.hardware [None req-cd1cfc40-8ce3-426e-b39e-039c90296f5e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Image pref 0:0:0 {{(pid=113020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 27 03:41:22.420306 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.virt.hardware [None req-cd1cfc40-8ce3-426e-b39e-039c90296f5e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=113020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 27 03:41:22.431935 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-cd1cfc40-8ce3-426e-b39e-039c90296f5e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:22.432742 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-cd1cfc40-8ce3-426e-b39e-039c90296f5e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:22.433831 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-cd1cfc40-8ce3-426e-b39e-039c90296f5e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:22.434507 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-cd1cfc40-8ce3-426e-b39e-039c90296f5e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:22.459026 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.quota [None req-cd1cfc40-8ce3-426e-b39e-039c90296f5e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Getting quotas for project 276e81e3da1f4d4c9c1881d1b1e863c4. Resources: {'instances', 'cores', 'ram'} {{(pid=113020) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 27 03:41:22.460379 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.quota [None req-cd1cfc40-8ce3-426e-b39e-039c90296f5e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Getting quotas for user 9c1aa1f7c98f42c5a047354bef07b355 and project 276e81e3da1f4d4c9c1881d1b1e863c4. Resources: {'instances', 'cores', 'ram'} {{(pid=113020) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 27 03:41:22.474310 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-cd1cfc40-8ce3-426e-b39e-039c90296f5e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Going to run 1 instances... {{(pid=113020) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 27 03:41:22.477922 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-cd1cfc40-8ce3-426e-b39e-039c90296f5e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78c0913d-0e41-4b41-b38f-f45c4f2535ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=113020) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 27 03:41:22.734913 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-cd1cfc40-8ce3-426e-b39e-039c90296f5e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.296722 May 27 03:41:22.735772 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 23/56] 10.222.0.25 () {60 vars in 1147 bytes} [Thu May 27 03:41:20 2021] POST /compute/v2.1/servers => generated 401 bytes in 2298 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 03:41:22.744829 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-a30fc302-bea4-469e-9b7c-533cfa51a2e7 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:22.747947 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-a30fc302-bea4-469e-9b7c-533cfa51a2e7 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:22.771653 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a30fc302-bea4-469e-9b7c-533cfa51a2e7 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:22.772579 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a30fc302-bea4-469e-9b7c-533cfa51a2e7 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:22.774496 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a30fc302-bea4-469e-9b7c-533cfa51a2e7 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:22.775274 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a30fc302-bea4-469e-9b7c-533cfa51a2e7 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:22.952791 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.virt.hardware [None req-06dcbc62-c5bf-49ba-ac44-c4c8b3470792 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Flavor limits 0:0:0 {{(pid=113021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 27 03:41:22.953228 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.virt.hardware [None req-06dcbc62-c5bf-49ba-ac44-c4c8b3470792 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Image limits 0:0:0 {{(pid=113021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 27 03:41:22.953746 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.virt.hardware [None req-06dcbc62-c5bf-49ba-ac44-c4c8b3470792 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Flavor pref 0:0:0 {{(pid=113021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 27 03:41:22.954757 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.virt.hardware [None req-06dcbc62-c5bf-49ba-ac44-c4c8b3470792 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Image pref 0:0:0 {{(pid=113021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 27 03:41:22.961375 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.virt.hardware [None req-06dcbc62-c5bf-49ba-ac44-c4c8b3470792 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=113021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 27 03:41:22.972741 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-06dcbc62-c5bf-49ba-ac44-c4c8b3470792 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:22.973452 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-06dcbc62-c5bf-49ba-ac44-c4c8b3470792 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:22.974396 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-06dcbc62-c5bf-49ba-ac44-c4c8b3470792 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:22.974995 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-06dcbc62-c5bf-49ba-ac44-c4c8b3470792 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:22.999249 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.quota [None req-06dcbc62-c5bf-49ba-ac44-c4c8b3470792 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Getting quotas for project 16ccb2756adb4055942bd0a0f0a061f4. Resources: {'instances', 'cores', 'ram'} {{(pid=113021) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 27 03:41:23.005996 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.quota [None req-06dcbc62-c5bf-49ba-ac44-c4c8b3470792 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Getting quotas for user e44e0bf02c8a48b1a5bbbfd71f2281bb and project 16ccb2756adb4055942bd0a0f0a061f4. Resources: {'instances', 'cores', 'ram'} {{(pid=113021) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 27 03:41:23.019534 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-06dcbc62-c5bf-49ba-ac44-c4c8b3470792 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Going to run 1 instances... {{(pid=113021) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 27 03:41:23.022309 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-06dcbc62-c5bf-49ba-ac44-c4c8b3470792 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78c0913d-0e41-4b41-b38f-f45c4f2535ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=113021) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 27 03:41:23.138189 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-a30fc302-bea4-469e-9b7c-533cfa51a2e7 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:23.155923 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-a30fc302-bea4-469e-9b7c-533cfa51a2e7 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0" status: 200 len: 1226 microversion: 2.1 time: 0.418180 May 27 03:41:23.160755 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 24/57] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:22 2021] GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0 => generated 1226 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:23.172277 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-493c79ea-6a7c-4716-b157-ac8dc4266164 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:23.173211 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-493c79ea-6a7c-4716-b157-ac8dc4266164 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 695616b8-9b90-4e8d-b719-de3eabe09cbe] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:23.186931 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-493c79ea-6a7c-4716-b157-ac8dc4266164 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:23.187300 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-493c79ea-6a7c-4716-b157-ac8dc4266164 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:23.188252 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-493c79ea-6a7c-4716-b157-ac8dc4266164 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:23.188744 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-493c79ea-6a7c-4716-b157-ac8dc4266164 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:23.231057 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-06dcbc62-c5bf-49ba-ac44-c4c8b3470792 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.594847 May 27 03:41:23.233143 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 34/58] 10.222.0.25 () {62 vars in 1188 bytes} [Thu May 27 03:41:21 2021] POST /compute/v2.1/servers => generated 401 bytes in 1602 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 27 03:41:23.242133 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-80a87d44-3dc5-41d5-8054-61e34b46d7b3 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:23.242833 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-80a87d44-3dc5-41d5-8054-61e34b46d7b3 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] [instance: 5d5fdc92-2d08-4ae1-a508-032e39ce0958] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:23.255941 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-80a87d44-3dc5-41d5-8054-61e34b46d7b3 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:23.256611 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-80a87d44-3dc5-41d5-8054-61e34b46d7b3 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:23.257994 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-80a87d44-3dc5-41d5-8054-61e34b46d7b3 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:23.272930 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-80a87d44-3dc5-41d5-8054-61e34b46d7b3 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:23.599683 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-493c79ea-6a7c-4716-b157-ac8dc4266164 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:23.626213 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-493c79ea-6a7c-4716-b157-ac8dc4266164 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/695616b8-9b90-4e8d-b719-de3eabe09cbe" status: 200 len: 1318 microversion: 2.1 time: 0.463638 May 27 03:41:23.626752 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 25/59] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:23 2021] GET /compute/v2.1/servers/695616b8-9b90-4e8d-b719-de3eabe09cbe => generated 1318 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:23.649987 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-0c0939e0-390a-4aee-a0cc-2560b11de1ca tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:23.650622 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-0c0939e0-390a-4aee-a0cc-2560b11de1ca tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:23.764699 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-0c0939e0-390a-4aee-a0cc-2560b11de1ca tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:23.773518 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-0c0939e0-390a-4aee-a0cc-2560b11de1ca tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1238 microversion: 2.1 time: 0.143635 May 27 03:41:23.774866 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 26/60] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:23 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1238 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:23.780114 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-f88511a9-c46e-432f-a66a-ffc07cdd5005 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:23.781291 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-f88511a9-c46e-432f-a66a-ffc07cdd5005 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:23.927630 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-f88511a9-c46e-432f-a66a-ffc07cdd5005 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:23.937555 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-f88511a9-c46e-432f-a66a-ffc07cdd5005 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:23.940314 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-f88511a9-c46e-432f-a66a-ffc07cdd5005 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:23.941758 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-f88511a9-c46e-432f-a66a-ffc07cdd5005 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1281 microversion: 2.20 time: 0.165625 May 27 03:41:23.942843 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 27/61] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:41:23 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1281 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:41:23.947695 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-f503c7c7-7784-479a-81a8-f60456ae7725 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1411291770", "imageRef": "78c0913d-0e41-4b41-b38f-f45c4f2535ff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b35bcef9-7d04-408a-b003-58c7e5878e65"}]}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:41:24.035671 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-80a87d44-3dc5-41d5-8054-61e34b46d7b3 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0207569193c64a2abbb1ae8f857d41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f220b161db454279a529469cc181cb86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:24.051813 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-80a87d44-3dc5-41d5-8054-61e34b46d7b3 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] 10.222.0.25 "GET /compute/v2.1/servers/5d5fdc92-2d08-4ae1-a508-032e39ce0958" status: 200 len: 1315 microversion: 2.1 time: 0.815864 May 27 03:41:24.052452 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 35/62] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:23 2021] GET /compute/v2.1/servers/5d5fdc92-2d08-4ae1-a508-032e39ce0958 => generated 1315 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:24.079930 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.network.neutron [None req-f503c7c7-7784-479a-81a8-f60456ae7725 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] validate_networks() for [('b35bcef9-7d04-408a-b003-58c7e5878e65', None, None, None)] {{(pid=113020) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 27 03:41:24.644272 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-57e8b8b1-778c-4a78-bb40-3017c6fef26a tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:24.644977 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-57e8b8b1-778c-4a78-bb40-3017c6fef26a tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 695616b8-9b90-4e8d-b719-de3eabe09cbe] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:24.671463 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-57e8b8b1-778c-4a78-bb40-3017c6fef26a tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:24.671931 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-57e8b8b1-778c-4a78-bb40-3017c6fef26a tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:24.672801 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-57e8b8b1-778c-4a78-bb40-3017c6fef26a tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:24.673275 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-57e8b8b1-778c-4a78-bb40-3017c6fef26a tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:25.290191 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.virt.hardware [None req-f503c7c7-7784-479a-81a8-f60456ae7725 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Flavor limits 0:0:0 {{(pid=113020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 27 03:41:25.290661 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.virt.hardware [None req-f503c7c7-7784-479a-81a8-f60456ae7725 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Image limits 0:0:0 {{(pid=113020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 27 03:41:25.291123 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.virt.hardware [None req-f503c7c7-7784-479a-81a8-f60456ae7725 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Flavor pref 0:0:0 {{(pid=113020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 27 03:41:25.291551 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.virt.hardware [None req-f503c7c7-7784-479a-81a8-f60456ae7725 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Image pref 0:0:0 {{(pid=113020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 27 03:41:25.291983 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.virt.hardware [None req-f503c7c7-7784-479a-81a8-f60456ae7725 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=113020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 27 03:41:25.301953 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f503c7c7-7784-479a-81a8-f60456ae7725 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:25.302742 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f503c7c7-7784-479a-81a8-f60456ae7725 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:25.303404 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f503c7c7-7784-479a-81a8-f60456ae7725 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:25.303864 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f503c7c7-7784-479a-81a8-f60456ae7725 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:25.326415 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.quota [None req-f503c7c7-7784-479a-81a8-f60456ae7725 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Getting quotas for project fa24b9f82e13448382e6b5f6bd699fab. Resources: {'instances', 'cores', 'ram'} {{(pid=113020) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 27 03:41:25.330491 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.quota [None req-f503c7c7-7784-479a-81a8-f60456ae7725 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Getting quotas for user 806656c3c07441d98bf4bf9e10c0296d and project fa24b9f82e13448382e6b5f6bd699fab. Resources: {'instances', 'cores', 'ram'} {{(pid=113020) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 27 03:41:25.341475 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-f503c7c7-7784-479a-81a8-f60456ae7725 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Going to run 1 instances... {{(pid=113020) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 27 03:41:25.343782 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-f503c7c7-7784-479a-81a8-f60456ae7725 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: e3449057-b2c6-4b15-b705-4076eddfefff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78c0913d-0e41-4b41-b38f-f45c4f2535ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=113020) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 27 03:41:25.410201 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-57e8b8b1-778c-4a78-bb40-3017c6fef26a tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:25.419131 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-57e8b8b1-778c-4a78-bb40-3017c6fef26a tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/695616b8-9b90-4e8d-b719-de3eabe09cbe" status: 200 len: 1318 microversion: 2.1 time: 0.779219 May 27 03:41:25.419947 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 36/63] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:24 2021] GET /compute/v2.1/servers/695616b8-9b90-4e8d-b719-de3eabe09cbe => generated 1318 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:41:25.429611 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-952f1db7-6783-466b-b2de-df68b0483548 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:25.430667 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-952f1db7-6783-466b-b2de-df68b0483548 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:25.440038 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-952f1db7-6783-466b-b2de-df68b0483548 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:25.440038 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-952f1db7-6783-466b-b2de-df68b0483548 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:25.440762 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-952f1db7-6783-466b-b2de-df68b0483548 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:25.441197 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-952f1db7-6783-466b-b2de-df68b0483548 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:25.493652 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-f503c7c7-7784-479a-81a8-f60456ae7725 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.549330 May 27 03:41:25.499936 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 28/64] 10.222.0.25 () {60 vars in 1147 bytes} [Thu May 27 03:41:23 2021] POST /compute/v2.1/servers => generated 383 bytes in 1556 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 03:41:25.505374 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-0419285b-7d2d-4f41-ab37-2c0f7f1e29b1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:25.506003 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-0419285b-7d2d-4f41-ab37-2c0f7f1e29b1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:25.524853 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0419285b-7d2d-4f41-ab37-2c0f7f1e29b1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:25.525495 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0419285b-7d2d-4f41-ab37-2c0f7f1e29b1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:25.526465 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0419285b-7d2d-4f41-ab37-2c0f7f1e29b1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:25.527059 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0419285b-7d2d-4f41-ab37-2c0f7f1e29b1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:25.638072 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-952f1db7-6783-466b-b2de-df68b0483548 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:25.649074 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-952f1db7-6783-466b-b2de-df68b0483548 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1290 microversion: 2.1 time: 0.227407 May 27 03:41:25.649548 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 37/65] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:25 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1290 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:25.654874 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-96f3f5c4-d00d-42f9-aede-263227dcca34 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:25.655760 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-96f3f5c4-d00d-42f9-aede-263227dcca34 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] [instance: 5d5fdc92-2d08-4ae1-a508-032e39ce0958] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:25.665251 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-96f3f5c4-d00d-42f9-aede-263227dcca34 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:25.665861 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-96f3f5c4-d00d-42f9-aede-263227dcca34 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:25.666752 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-96f3f5c4-d00d-42f9-aede-263227dcca34 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:25.667276 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-96f3f5c4-d00d-42f9-aede-263227dcca34 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:25.698511 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-0419285b-7d2d-4f41-ab37-2c0f7f1e29b1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:25.718301 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-0419285b-7d2d-4f41-ab37-2c0f7f1e29b1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:25.720751 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-0419285b-7d2d-4f41-ab37-2c0f7f1e29b1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:25.722069 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-0419285b-7d2d-4f41-ab37-2c0f7f1e29b1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1277 microversion: 2.20 time: 0.220992 May 27 03:41:25.723151 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 29/66] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:41:25 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1277 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:41:25.727754 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-8c7475d8-9456-4074-b36a-d8d1b707027d tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:25.728535 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-8c7475d8-9456-4074-b36a-d8d1b707027d tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: e3449057-b2c6-4b15-b705-4076eddfefff] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:25.863439 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-8c7475d8-9456-4074-b36a-d8d1b707027d tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:25.872024 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-8c7475d8-9456-4074-b36a-d8d1b707027d tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff" status: 200 len: 1222 microversion: 2.1 time: 0.147612 May 27 03:41:25.872916 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 30/67] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:25 2021] GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff => generated 1222 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:26.331940 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-96f3f5c4-d00d-42f9-aede-263227dcca34 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0207569193c64a2abbb1ae8f857d41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f220b161db454279a529469cc181cb86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:26.340375 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-96f3f5c4-d00d-42f9-aede-263227dcca34 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] 10.222.0.25 "GET /compute/v2.1/servers/5d5fdc92-2d08-4ae1-a508-032e39ce0958" status: 200 len: 1315 microversion: 2.1 time: 0.689693 May 27 03:41:26.348478 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 38/68] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:25 2021] GET /compute/v2.1/servers/5d5fdc92-2d08-4ae1-a508-032e39ce0958 => generated 1315 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:26.437276 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-423d9db9-a3fe-46d3-95b5-5a19ccb0f5a1 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:26.437900 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-423d9db9-a3fe-46d3-95b5-5a19ccb0f5a1 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 695616b8-9b90-4e8d-b719-de3eabe09cbe] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:26.463243 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-423d9db9-a3fe-46d3-95b5-5a19ccb0f5a1 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:26.465764 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-423d9db9-a3fe-46d3-95b5-5a19ccb0f5a1 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:26.466945 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-423d9db9-a3fe-46d3-95b5-5a19ccb0f5a1 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:26.467626 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-423d9db9-a3fe-46d3-95b5-5a19ccb0f5a1 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:26.667713 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-d4109c74-3940-4d4f-9f69-7d9475efedca tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:26.669454 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-d4109c74-3940-4d4f-9f69-7d9475efedca tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:26.685780 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d4109c74-3940-4d4f-9f69-7d9475efedca tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:26.687313 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d4109c74-3940-4d4f-9f69-7d9475efedca tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:26.690278 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d4109c74-3940-4d4f-9f69-7d9475efedca tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:26.690752 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d4109c74-3940-4d4f-9f69-7d9475efedca tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:26.887335 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-423d9db9-a3fe-46d3-95b5-5a19ccb0f5a1 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:26.899131 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-423d9db9-a3fe-46d3-95b5-5a19ccb0f5a1 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/695616b8-9b90-4e8d-b719-de3eabe09cbe" status: 200 len: 1318 microversion: 2.1 time: 0.465895 May 27 03:41:26.900259 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 31/69] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:26 2021] GET /compute/v2.1/servers/695616b8-9b90-4e8d-b719-de3eabe09cbe => generated 1318 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:26.906748 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-9f0ce671-6144-4184-8961-e3ffe0da3b70 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:26.907771 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-9f0ce671-6144-4184-8961-e3ffe0da3b70 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:26.917245 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9f0ce671-6144-4184-8961-e3ffe0da3b70 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:26.917911 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9f0ce671-6144-4184-8961-e3ffe0da3b70 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:26.920003 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9f0ce671-6144-4184-8961-e3ffe0da3b70 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:26.921058 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9f0ce671-6144-4184-8961-e3ffe0da3b70 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:27.044064 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-d4109c74-3940-4d4f-9f69-7d9475efedca tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:27.061540 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-d4109c74-3940-4d4f-9f69-7d9475efedca tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1296 microversion: 2.1 time: 0.398299 May 27 03:41:27.061972 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 39/70] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:26 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1296 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:27.076750 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-e560d147-ed9e-445c-88d1-26cd39689901 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:27.077408 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-e560d147-ed9e-445c-88d1-26cd39689901 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: e3449057-b2c6-4b15-b705-4076eddfefff] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:27.087168 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-9f0ce671-6144-4184-8961-e3ffe0da3b70 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:27.096348 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e560d147-ed9e-445c-88d1-26cd39689901 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:27.096832 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e560d147-ed9e-445c-88d1-26cd39689901 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:27.097652 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e560d147-ed9e-445c-88d1-26cd39689901 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:27.098051 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e560d147-ed9e-445c-88d1-26cd39689901 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:27.128117 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-9f0ce671-6144-4184-8961-e3ffe0da3b70 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:27.129692 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-9f0ce671-6144-4184-8961-e3ffe0da3b70 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:27.130867 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-9f0ce671-6144-4184-8961-e3ffe0da3b70 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1341 microversion: 2.20 time: 0.228217 May 27 03:41:27.145024 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 32/71] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:41:26 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1341 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:41:27.701237 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [req-8effdd57-ab66-41cc-b1b5-bc2af2aae088 req-5b24a532-8e9f-4d3b-b82d-ecea77629ffc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "695616b8-9b90-4e8d-b719-de3eabe09cbe", "name": "network-vif-plugged", "status": "completed", "tag": "1279817e-ea8d-4755-966e-3691e51297b7"}]} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:41:27.704272 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:41:27.704272 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: warnings.warn(msg) May 27 03:41:27.709039 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-e560d147-ed9e-445c-88d1-26cd39689901 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:27.713968 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-8effdd57-ab66-41cc-b1b5-bc2af2aae088 req-5b24a532-8e9f-4d3b-b82d-ecea77629ffc service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:27.713968 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-8effdd57-ab66-41cc-b1b5-bc2af2aae088 req-5b24a532-8e9f-4d3b-b82d-ecea77629ffc service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:27.723119 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-e560d147-ed9e-445c-88d1-26cd39689901 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff" status: 200 len: 1218 microversion: 2.1 time: 0.649637 May 27 03:41:27.724243 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 40/72] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:27 2021] GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff => generated 1218 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:27.731042 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-b82539bd-2ad5-431f-a3b0-989a0fa45183 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:27.732485 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-b82539bd-2ad5-431f-a3b0-989a0fa45183 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] [instance: 5d5fdc92-2d08-4ae1-a508-032e39ce0958] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:27.744702 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.compute.server_external_events [req-8effdd57-ab66-41cc-b1b5-bc2af2aae088 req-5b24a532-8e9f-4d3b-b82d-ecea77629ffc service nova] Creating event network-vif-plugged:1279817e-ea8d-4755-966e-3691e51297b7 for instance 695616b8-9b90-4e8d-b719-de3eabe09cbe on hv-cinder-79326 May 27 03:41:27.745228 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-8effdd57-ab66-41cc-b1b5-bc2af2aae088 req-5b24a532-8e9f-4d3b-b82d-ecea77629ffc service nova] Acquired lock "compute-rpcapi-router" {{(pid=113020) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} May 27 03:41:27.746520 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d8628acb-a316-4358-a6e6-b0797f7473b7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:27.747146 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d8628acb-a316-4358-a6e6-b0797f7473b7 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:27.749924 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d8628acb-a316-4358-a6e6-b0797f7473b7 None None] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:27.749924 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d8628acb-a316-4358-a6e6-b0797f7473b7 None None] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:27.751977 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b82539bd-2ad5-431f-a3b0-989a0fa45183 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:27.753076 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b82539bd-2ad5-431f-a3b0-989a0fa45183 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:27.754112 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b82539bd-2ad5-431f-a3b0-989a0fa45183 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:27.756331 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b82539bd-2ad5-431f-a3b0-989a0fa45183 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:27.759045 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.compute.rpcapi [None req-d8628acb-a316-4358-a6e6-b0797f7473b7 None None] Automatically selected compute RPC version 6.0 from minimum service version 56 May 27 03:41:27.760646 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d8628acb-a316-4358-a6e6-b0797f7473b7 None None] Releasing lock "compute-rpcapi-router" {{(pid=113020) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} May 27 03:41:27.794614 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-d8628acb-a316-4358-a6e6-b0797f7473b7 None None] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.649637 May 27 03:41:27.796018 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 33/73] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:41:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:41:27.916553 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-68a436a0-12fa-493f-8e54-21cc1b7c8dda tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:27.917974 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-68a436a0-12fa-493f-8e54-21cc1b7c8dda tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 695616b8-9b90-4e8d-b719-de3eabe09cbe] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:27.926697 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-68a436a0-12fa-493f-8e54-21cc1b7c8dda tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:27.927665 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-68a436a0-12fa-493f-8e54-21cc1b7c8dda tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:27.928737 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-68a436a0-12fa-493f-8e54-21cc1b7c8dda tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:27.929390 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-68a436a0-12fa-493f-8e54-21cc1b7c8dda tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:28.408997 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-68a436a0-12fa-493f-8e54-21cc1b7c8dda tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:28.420106 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-68a436a0-12fa-493f-8e54-21cc1b7c8dda tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/695616b8-9b90-4e8d-b719-de3eabe09cbe" status: 200 len: 1318 microversion: 2.1 time: 0.507561 May 27 03:41:28.431090 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 34/74] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:27 2021] GET /compute/v2.1/servers/695616b8-9b90-4e8d-b719-de3eabe09cbe => generated 1318 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:41:28.441167 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-08a22961-674f-4b89-a050-e7bf425e4257 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:28.443898 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-08a22961-674f-4b89-a050-e7bf425e4257 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:28.461517 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-08a22961-674f-4b89-a050-e7bf425e4257 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:28.462162 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-08a22961-674f-4b89-a050-e7bf425e4257 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:28.463116 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-08a22961-674f-4b89-a050-e7bf425e4257 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:28.463711 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-08a22961-674f-4b89-a050-e7bf425e4257 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:28.683838 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-08a22961-674f-4b89-a050-e7bf425e4257 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:28.696058 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-08a22961-674f-4b89-a050-e7bf425e4257 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1296 microversion: 2.1 time: 0.263751 May 27 03:41:28.697724 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 35/75] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:28 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1296 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:28.703367 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-048cd93c-989d-4cdf-8d00-7c065674856f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:28.710784 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-048cd93c-989d-4cdf-8d00-7c065674856f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:28.724241 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-048cd93c-989d-4cdf-8d00-7c065674856f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:28.725263 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-048cd93c-989d-4cdf-8d00-7c065674856f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:28.727015 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-048cd93c-989d-4cdf-8d00-7c065674856f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:28.727729 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-048cd93c-989d-4cdf-8d00-7c065674856f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:28.933627 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-048cd93c-989d-4cdf-8d00-7c065674856f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:28.948262 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-b82539bd-2ad5-431f-a3b0-989a0fa45183 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0207569193c64a2abbb1ae8f857d41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f220b161db454279a529469cc181cb86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:28.960303 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-048cd93c-989d-4cdf-8d00-7c065674856f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:28.964621 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-b82539bd-2ad5-431f-a3b0-989a0fa45183 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] 10.222.0.25 "GET /compute/v2.1/servers/5d5fdc92-2d08-4ae1-a508-032e39ce0958" status: 200 len: 1315 microversion: 2.1 time: 1.237769 May 27 03:41:28.974932 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 41/76] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:27 2021] GET /compute/v2.1/servers/5d5fdc92-2d08-4ae1-a508-032e39ce0958 => generated 1315 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:28.974932 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-2385c840-7b58-4615-afe5-e8e30640b8e1 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:28.974932 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-2385c840-7b58-4615-afe5-e8e30640b8e1 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: e3449057-b2c6-4b15-b705-4076eddfefff] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:28.979318 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-048cd93c-989d-4cdf-8d00-7c065674856f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:28.986438 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-048cd93c-989d-4cdf-8d00-7c065674856f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1339 microversion: 2.20 time: 0.284919 May 27 03:41:28.987224 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 36/77] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:41:28 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1339 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:41:29.002175 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2385c840-7b58-4615-afe5-e8e30640b8e1 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:29.002636 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2385c840-7b58-4615-afe5-e8e30640b8e1 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:29.003434 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2385c840-7b58-4615-afe5-e8e30640b8e1 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:29.004069 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2385c840-7b58-4615-afe5-e8e30640b8e1 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:29.274414 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-2385c840-7b58-4615-afe5-e8e30640b8e1 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:29.289865 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-2385c840-7b58-4615-afe5-e8e30640b8e1 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff" status: 200 len: 1280 microversion: 2.1 time: 0.323590 May 27 03:41:29.306857 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 42/78] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:28 2021] GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff => generated 1280 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:29.443839 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-7be87a39-8c6e-4c90-879f-82b5fa2105bb tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:29.444616 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-7be87a39-8c6e-4c90-879f-82b5fa2105bb tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 695616b8-9b90-4e8d-b719-de3eabe09cbe] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:29.456025 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7be87a39-8c6e-4c90-879f-82b5fa2105bb tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:29.456692 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7be87a39-8c6e-4c90-879f-82b5fa2105bb tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:29.458516 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7be87a39-8c6e-4c90-879f-82b5fa2105bb tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:29.459558 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7be87a39-8c6e-4c90-879f-82b5fa2105bb tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:29.713840 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-d461b7a5-c36b-405c-b410-c19b351d77dd tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:29.714824 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-d461b7a5-c36b-405c-b410-c19b351d77dd tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:29.723393 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d461b7a5-c36b-405c-b410-c19b351d77dd tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:29.723859 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d461b7a5-c36b-405c-b410-c19b351d77dd tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:29.724681 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d461b7a5-c36b-405c-b410-c19b351d77dd tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:29.725282 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d461b7a5-c36b-405c-b410-c19b351d77dd tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:29.892039 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-7be87a39-8c6e-4c90-879f-82b5fa2105bb tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:29.917042 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-7be87a39-8c6e-4c90-879f-82b5fa2105bb tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/695616b8-9b90-4e8d-b719-de3eabe09cbe" status: 200 len: 1318 microversion: 2.1 time: 0.480496 May 27 03:41:29.932570 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 37/79] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:29 2021] GET /compute/v2.1/servers/695616b8-9b90-4e8d-b719-de3eabe09cbe => generated 1318 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:29.937509 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [req-64f30d2c-dd89-4c79-ae99-e792656819cb req-148da449-5936-413f-9ffe-75b6e8464500 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d5fdc92-2d08-4ae1-a508-032e39ce0958", "name": "network-vif-plugged", "status": "completed", "tag": "1bbb12ef-9a7a-4069-a54e-b707ce9a6809"}]} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:41:29.939166 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:41:29.939166 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: warnings.warn(msg) May 27 03:41:29.947698 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-64f30d2c-dd89-4c79-ae99-e792656819cb req-148da449-5936-413f-9ffe-75b6e8464500 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:29.948455 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-64f30d2c-dd89-4c79-ae99-e792656819cb req-148da449-5936-413f-9ffe-75b6e8464500 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:29.966725 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.compute.server_external_events [req-64f30d2c-dd89-4c79-ae99-e792656819cb req-148da449-5936-413f-9ffe-75b6e8464500 service nova] Creating event network-vif-plugged:1bbb12ef-9a7a-4069-a54e-b707ce9a6809 for instance 5d5fdc92-2d08-4ae1-a508-032e39ce0958 on hv-cinder-79326 May 27 03:41:29.973086 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [req-64f30d2c-dd89-4c79-ae99-e792656819cb req-148da449-5936-413f-9ffe-75b6e8464500 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039039 May 27 03:41:29.974091 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 38/80] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:41:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:41:29.983873 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-c55e4e04-da78-4f99-9116-2c03ce81f648 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:29.985674 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-c55e4e04-da78-4f99-9116-2c03ce81f648 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] [instance: 5d5fdc92-2d08-4ae1-a508-032e39ce0958] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:29.997843 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c55e4e04-da78-4f99-9116-2c03ce81f648 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:29.998615 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c55e4e04-da78-4f99-9116-2c03ce81f648 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:29.999810 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c55e4e04-da78-4f99-9116-2c03ce81f648 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:30.001149 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c55e4e04-da78-4f99-9116-2c03ce81f648 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:30.642645 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-c55e4e04-da78-4f99-9116-2c03ce81f648 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0207569193c64a2abbb1ae8f857d41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f220b161db454279a529469cc181cb86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:30.658581 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-c55e4e04-da78-4f99-9116-2c03ce81f648 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] 10.222.0.25 "GET /compute/v2.1/servers/5d5fdc92-2d08-4ae1-a508-032e39ce0958" status: 200 len: 1315 microversion: 2.1 time: 0.680523 May 27 03:41:30.668476 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 39/81] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:29 2021] GET /compute/v2.1/servers/5d5fdc92-2d08-4ae1-a508-032e39ce0958 => generated 1315 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:30.674665 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-545b7c69-bc5d-4140-8b37-0c52b561bb1a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:30.676726 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-545b7c69-bc5d-4140-8b37-0c52b561bb1a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:30.694336 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-545b7c69-bc5d-4140-8b37-0c52b561bb1a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:30.694888 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-545b7c69-bc5d-4140-8b37-0c52b561bb1a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:30.695810 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-545b7c69-bc5d-4140-8b37-0c52b561bb1a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:30.697407 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-545b7c69-bc5d-4140-8b37-0c52b561bb1a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:30.806869 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-d461b7a5-c36b-405c-b410-c19b351d77dd tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:30.818868 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-d461b7a5-c36b-405c-b410-c19b351d77dd tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1363 microversion: 2.1 time: 1.108461 May 27 03:41:30.831961 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 43/82] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:29 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1363 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:41:30.849264 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [req-ca9a218f-0aff-48f4-8be1-fe32ca1f8c54 req-133625f0-10f5-4e4c-be0e-68495deb29b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0", "tag": "3f12ac65-af0d-4c74-bfa1-375cddc42ae8"}]} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:41:30.850939 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:41:30.850939 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: warnings.warn(msg) May 27 03:41:30.873590 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-ca9a218f-0aff-48f4-8be1-fe32ca1f8c54 req-133625f0-10f5-4e4c-be0e-68495deb29b0 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:30.874548 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-ca9a218f-0aff-48f4-8be1-fe32ca1f8c54 req-133625f0-10f5-4e4c-be0e-68495deb29b0 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:30.937722 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.compute.server_external_events [req-ca9a218f-0aff-48f4-8be1-fe32ca1f8c54 req-133625f0-10f5-4e4c-be0e-68495deb29b0 service nova] Creating event network-changed:3f12ac65-af0d-4c74-bfa1-375cddc42ae8 for instance 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0 on hv-cinder-79326 May 27 03:41:30.948441 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [req-ca9a218f-0aff-48f4-8be1-fe32ca1f8c54 req-133625f0-10f5-4e4c-be0e-68495deb29b0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114507 May 27 03:41:30.949637 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 44/83] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:41:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:41:30.963778 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-17c2fd1b-7145-4b1c-90b0-62115180665d tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:30.964501 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-17c2fd1b-7145-4b1c-90b0-62115180665d tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: e3449057-b2c6-4b15-b705-4076eddfefff] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:30.983535 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-17c2fd1b-7145-4b1c-90b0-62115180665d tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:30.984024 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-17c2fd1b-7145-4b1c-90b0-62115180665d tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:30.985064 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-17c2fd1b-7145-4b1c-90b0-62115180665d tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:30.985873 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-17c2fd1b-7145-4b1c-90b0-62115180665d tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:31.619963 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-545b7c69-bc5d-4140-8b37-0c52b561bb1a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:31.634316 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-545b7c69-bc5d-4140-8b37-0c52b561bb1a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:31.638666 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-545b7c69-bc5d-4140-8b37-0c52b561bb1a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:31.638666 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-545b7c69-bc5d-4140-8b37-0c52b561bb1a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1406 microversion: 2.20 time: 0.977642 May 27 03:41:31.638666 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 40/84] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:41:30 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1406 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:41:31.643767 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-d528f5a5-a14c-49f2-87cf-e0d4ad74a5e9 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:31.644518 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-d528f5a5-a14c-49f2-87cf-e0d4ad74a5e9 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 695616b8-9b90-4e8d-b719-de3eabe09cbe] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:31.652598 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d528f5a5-a14c-49f2-87cf-e0d4ad74a5e9 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:31.653053 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d528f5a5-a14c-49f2-87cf-e0d4ad74a5e9 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:31.654393 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d528f5a5-a14c-49f2-87cf-e0d4ad74a5e9 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:31.654842 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d528f5a5-a14c-49f2-87cf-e0d4ad74a5e9 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:31.971563 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-17c2fd1b-7145-4b1c-90b0-62115180665d tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:31.984453 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-17c2fd1b-7145-4b1c-90b0-62115180665d tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff" status: 200 len: 1322 microversion: 2.1 time: 1.030874 May 27 03:41:31.987743 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 45/85] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:30 2021] GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff => generated 1322 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:31.994665 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-de421f37-5664-4478-a8d4-1dc673a7f1cc tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:31.995546 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-de421f37-5664-4478-a8d4-1dc673a7f1cc tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] [instance: 5d5fdc92-2d08-4ae1-a508-032e39ce0958] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:32.008433 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-de421f37-5664-4478-a8d4-1dc673a7f1cc tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:32.012518 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-de421f37-5664-4478-a8d4-1dc673a7f1cc tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:32.012518 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-de421f37-5664-4478-a8d4-1dc673a7f1cc tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:32.012518 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-de421f37-5664-4478-a8d4-1dc673a7f1cc tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:32.107545 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-d528f5a5-a14c-49f2-87cf-e0d4ad74a5e9 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:32.116603 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-d528f5a5-a14c-49f2-87cf-e0d4ad74a5e9 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/695616b8-9b90-4e8d-b719-de3eabe09cbe" status: 200 len: 1508 microversion: 2.1 time: 0.476948 May 27 03:41:32.117672 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 41/86] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:31 2021] GET /compute/v2.1/servers/695616b8-9b90-4e8d-b719-de3eabe09cbe => generated 1508 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:32.134731 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-505cb55a-dc59-424f-aa54-2b76180c9901 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:32.135796 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-505cb55a-dc59-424f-aa54-2b76180c9901 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:32.155471 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-505cb55a-dc59-424f-aa54-2b76180c9901 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:32.156044 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-505cb55a-dc59-424f-aa54-2b76180c9901 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:32.156983 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-505cb55a-dc59-424f-aa54-2b76180c9901 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:32.157498 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-505cb55a-dc59-424f-aa54-2b76180c9901 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:32.750023 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-505cb55a-dc59-424f-aa54-2b76180c9901 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:32.759195 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-505cb55a-dc59-424f-aa54-2b76180c9901 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1363 microversion: 2.1 time: 0.640246 May 27 03:41:32.759785 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 42/87] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:32 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1363 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:32.768374 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-de05433e-759a-46b9-99d4-1e06925ced58 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:32.769396 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-de05433e-759a-46b9-99d4-1e06925ced58 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:32.779527 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-de05433e-759a-46b9-99d4-1e06925ced58 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:32.782410 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-de05433e-759a-46b9-99d4-1e06925ced58 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:32.782410 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-de05433e-759a-46b9-99d4-1e06925ced58 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:32.782410 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-de05433e-759a-46b9-99d4-1e06925ced58 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:33.316110 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-de05433e-759a-46b9-99d4-1e06925ced58 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:33.326773 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-de421f37-5664-4478-a8d4-1dc673a7f1cc tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0207569193c64a2abbb1ae8f857d41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f220b161db454279a529469cc181cb86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:33.334318 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-de05433e-759a-46b9-99d4-1e06925ced58 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:33.337616 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-de05433e-759a-46b9-99d4-1e06925ced58 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:33.338827 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-de05433e-759a-46b9-99d4-1e06925ced58 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1406 microversion: 2.20 time: 0.578063 May 27 03:41:33.339349 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-de421f37-5664-4478-a8d4-1dc673a7f1cc tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] 10.222.0.25 "GET /compute/v2.1/servers/5d5fdc92-2d08-4ae1-a508-032e39ce0958" status: 200 len: 1315 microversion: 2.1 time: 1.349852 May 27 03:41:33.339466 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 43/88] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:41:32 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1406 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:41:33.351615 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 46/89] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:31 2021] GET /compute/v2.1/servers/5d5fdc92-2d08-4ae1-a508-032e39ce0958 => generated 1315 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:33.356287 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-958a486f-a5e3-435c-950c-8926461fde96 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:33.356932 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-958a486f-a5e3-435c-950c-8926461fde96 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: e3449057-b2c6-4b15-b705-4076eddfefff] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:33.365155 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-958a486f-a5e3-435c-950c-8926461fde96 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:33.365608 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-958a486f-a5e3-435c-950c-8926461fde96 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:33.366391 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-958a486f-a5e3-435c-950c-8926461fde96 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:33.366827 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-958a486f-a5e3-435c-950c-8926461fde96 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:33.639378 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [req-a3a05f21-2c42-4d3b-8aeb-384ee9df9783 req-7e359ad6-c42b-4549-9b13-f74b52cd126f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3449057-b2c6-4b15-b705-4076eddfefff", "tag": "b78c21a4-6cab-4194-9f32-cbe141d6578d"}]} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:41:33.641351 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:41:33.641351 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: warnings.warn(msg) May 27 03:41:33.656211 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-a3a05f21-2c42-4d3b-8aeb-384ee9df9783 req-7e359ad6-c42b-4549-9b13-f74b52cd126f service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:33.656794 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-a3a05f21-2c42-4d3b-8aeb-384ee9df9783 req-7e359ad6-c42b-4549-9b13-f74b52cd126f service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:33.676739 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.compute.server_external_events [req-a3a05f21-2c42-4d3b-8aeb-384ee9df9783 req-7e359ad6-c42b-4549-9b13-f74b52cd126f service nova] Creating event network-changed:b78c21a4-6cab-4194-9f32-cbe141d6578d for instance e3449057-b2c6-4b15-b705-4076eddfefff on hv-cinder-79326 May 27 03:41:33.681851 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [req-a3a05f21-2c42-4d3b-8aeb-384ee9df9783 req-7e359ad6-c42b-4549-9b13-f74b52cd126f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.338456 May 27 03:41:33.685030 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 44/90] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:41:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:41:33.781702 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-8faf46c5-b1da-4575-af9c-b99a8969fe8c tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:33.783167 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-8faf46c5-b1da-4575-af9c-b99a8969fe8c tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:33.801873 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8faf46c5-b1da-4575-af9c-b99a8969fe8c tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:33.815198 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8faf46c5-b1da-4575-af9c-b99a8969fe8c tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:33.817046 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8faf46c5-b1da-4575-af9c-b99a8969fe8c tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:33.817805 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8faf46c5-b1da-4575-af9c-b99a8969fe8c tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:34.379219 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-8faf46c5-b1da-4575-af9c-b99a8969fe8c tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:34.387466 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-8faf46c5-b1da-4575-af9c-b99a8969fe8c tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1363 microversion: 2.1 time: 0.613177 May 27 03:41:34.388044 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 45/91] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:33 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1363 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:34.392976 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [req-e03c7ec4-6cb5-46ed-a6dc-52237a9924a3 req-0a92fb94-8e35-47de-beec-b84828737547 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c7e656a-afc5-4119-a11e-920c583d89d2", "tag": "24177437-ade1-43c7-bd7d-340757426924"}]} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:41:34.395047 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:41:34.395047 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: warnings.warn(msg) May 27 03:41:34.404609 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-e03c7ec4-6cb5-46ed-a6dc-52237a9924a3 req-0a92fb94-8e35-47de-beec-b84828737547 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:34.405048 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-e03c7ec4-6cb5-46ed-a6dc-52237a9924a3 req-0a92fb94-8e35-47de-beec-b84828737547 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:34.422317 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.compute.server_external_events [req-e03c7ec4-6cb5-46ed-a6dc-52237a9924a3 req-0a92fb94-8e35-47de-beec-b84828737547 service nova] Creating event network-changed:24177437-ade1-43c7-bd7d-340757426924 for instance 3c7e656a-afc5-4119-a11e-920c583d89d2 on hv-cinder-79326 May 27 03:41:34.427221 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [req-e03c7ec4-6cb5-46ed-a6dc-52237a9924a3 req-0a92fb94-8e35-47de-beec-b84828737547 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037927 May 27 03:41:34.427818 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 46/92] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:41:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:41:34.434221 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-0c8afbf0-8bbc-415f-8033-4bd16a200863 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:34.435257 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-0c8afbf0-8bbc-415f-8033-4bd16a200863 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:34.442904 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0c8afbf0-8bbc-415f-8033-4bd16a200863 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:34.443339 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0c8afbf0-8bbc-415f-8033-4bd16a200863 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:34.444198 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0c8afbf0-8bbc-415f-8033-4bd16a200863 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:34.444662 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0c8afbf0-8bbc-415f-8033-4bd16a200863 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:34.549192 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-958a486f-a5e3-435c-950c-8926461fde96 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:34.564896 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-958a486f-a5e3-435c-950c-8926461fde96 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff" status: 200 len: 1322 microversion: 2.1 time: 1.212106 May 27 03:41:34.574751 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 47/93] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:33 2021] GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff => generated 1322 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:34.574751 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-26db72fa-b974-4e0d-9477-f3cb7747d688 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:34.574751 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-26db72fa-b974-4e0d-9477-f3cb7747d688 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] [instance: 5d5fdc92-2d08-4ae1-a508-032e39ce0958] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:34.579581 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-26db72fa-b974-4e0d-9477-f3cb7747d688 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:34.580314 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-26db72fa-b974-4e0d-9477-f3cb7747d688 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:34.581174 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-26db72fa-b974-4e0d-9477-f3cb7747d688 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:34.585534 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-26db72fa-b974-4e0d-9477-f3cb7747d688 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:34.862602 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-0c8afbf0-8bbc-415f-8033-4bd16a200863 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:34.873909 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-0c8afbf0-8bbc-415f-8033-4bd16a200863 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:34.886960 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-0c8afbf0-8bbc-415f-8033-4bd16a200863 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:34.888120 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-0c8afbf0-8bbc-415f-8033-4bd16a200863 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1406 microversion: 2.20 time: 0.458931 May 27 03:41:34.889217 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 47/94] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:41:34 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1406 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:41:34.894517 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-b8881638-0a9a-4a71-8341-4f83bdb6933e tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "49adedce-6897-4136-8d88-700512754351"}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:41:34.895773 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-b8881638-0a9a-4a71-8341-4f83bdb6933e tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 695616b8-9b90-4e8d-b719-de3eabe09cbe] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:34.904873 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b8881638-0a9a-4a71-8341-4f83bdb6933e tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:34.905324 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b8881638-0a9a-4a71-8341-4f83bdb6933e tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:34.906103 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b8881638-0a9a-4a71-8341-4f83bdb6933e tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:34.906588 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b8881638-0a9a-4a71-8341-4f83bdb6933e tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:35.647185 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-26db72fa-b974-4e0d-9477-f3cb7747d688 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0207569193c64a2abbb1ae8f857d41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f220b161db454279a529469cc181cb86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:35.652873 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-26db72fa-b974-4e0d-9477-f3cb7747d688 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] 10.222.0.25 "GET /compute/v2.1/servers/5d5fdc92-2d08-4ae1-a508-032e39ce0958" status: 200 len: 1502 microversion: 2.1 time: 1.085863 May 27 03:41:35.655402 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 48/95] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:34 2021] GET /compute/v2.1/servers/5d5fdc92-2d08-4ae1-a508-032e39ce0958 => generated 1502 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:35.674359 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-448e63ef-08c2-460b-acef-8e35536e4a7e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:35.674988 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-448e63ef-08c2-460b-acef-8e35536e4a7e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:35.692294 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-448e63ef-08c2-460b-acef-8e35536e4a7e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:35.692901 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-448e63ef-08c2-460b-acef-8e35536e4a7e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:35.693701 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-448e63ef-08c2-460b-acef-8e35536e4a7e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:35.695870 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-448e63ef-08c2-460b-acef-8e35536e4a7e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:36.107947 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-b8881638-0a9a-4a71-8341-4f83bdb6933e tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "POST /compute/v2.1/servers/695616b8-9b90-4e8d-b719-de3eabe09cbe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.217284 May 27 03:41:36.109226 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 48/96] 10.222.0.25 () {60 vars in 1323 bytes} [Thu May 27 03:41:34 2021] POST /compute/v2.1/servers/695616b8-9b90-4e8d-b719-de3eabe09cbe/os-volume_attachments => generated 194 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:41:36.114467 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-0658d871-a1fb-44d6-9e04-4a7cdc7336ae tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:36.115199 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-0658d871-a1fb-44d6-9e04-4a7cdc7336ae tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: e3449057-b2c6-4b15-b705-4076eddfefff] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:36.122903 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0658d871-a1fb-44d6-9e04-4a7cdc7336ae tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:36.123356 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0658d871-a1fb-44d6-9e04-4a7cdc7336ae tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:36.124141 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0658d871-a1fb-44d6-9e04-4a7cdc7336ae tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:36.124617 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0658d871-a1fb-44d6-9e04-4a7cdc7336ae tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:36.288234 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-448e63ef-08c2-460b-acef-8e35536e4a7e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:36.302112 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-448e63ef-08c2-460b-acef-8e35536e4a7e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1363 microversion: 2.1 time: 0.644014 May 27 03:41:36.302932 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 49/97] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:35 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1363 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:36.318574 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-3e2a5aa0-3902-4c06-9401-8bd28d639fed tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:36.318574 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-3e2a5aa0-3902-4c06-9401-8bd28d639fed tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:36.318574 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-3e2a5aa0-3902-4c06-9401-8bd28d639fed tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:36.318574 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-3e2a5aa0-3902-4c06-9401-8bd28d639fed tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:36.318926 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-3e2a5aa0-3902-4c06-9401-8bd28d639fed tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:36.318926 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-3e2a5aa0-3902-4c06-9401-8bd28d639fed tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:36.705934 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-0658d871-a1fb-44d6-9e04-4a7cdc7336ae tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:36.719815 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-0658d871-a1fb-44d6-9e04-4a7cdc7336ae tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff" status: 200 len: 1322 microversion: 2.1 time: 0.609184 May 27 03:41:36.721061 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 49/98] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:36 2021] GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff => generated 1322 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:36.734444 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [req-93e2758c-e30b-40ea-92d1-89ad246f9f57 req-d155e99e-1501-420f-a673-4d6a67ff989b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e367eb4b-29c5-4f41-b41d-0da84d751fe2", "tag": "396ee32c-72a8-43ea-b35c-f0de6de19d7a"}]} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:41:36.741459 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:41:36.741459 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: warnings.warn(msg) May 27 03:41:36.752880 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-93e2758c-e30b-40ea-92d1-89ad246f9f57 req-d155e99e-1501-420f-a673-4d6a67ff989b service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:36.753367 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-93e2758c-e30b-40ea-92d1-89ad246f9f57 req-d155e99e-1501-420f-a673-4d6a67ff989b service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:36.776834 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.compute.server_external_events [req-93e2758c-e30b-40ea-92d1-89ad246f9f57 req-d155e99e-1501-420f-a673-4d6a67ff989b service nova] Creating event network-changed:396ee32c-72a8-43ea-b35c-f0de6de19d7a for instance e367eb4b-29c5-4f41-b41d-0da84d751fe2 on hv-cinder-79326 May 27 03:41:36.782420 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [req-93e2758c-e30b-40ea-92d1-89ad246f9f57 req-d155e99e-1501-420f-a673-4d6a67ff989b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059960 May 27 03:41:36.783411 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 50/99] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:41:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:41:37.099148 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-3e2a5aa0-3902-4c06-9401-8bd28d639fed tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:37.110865 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-3e2a5aa0-3902-4c06-9401-8bd28d639fed tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:37.112526 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-3e2a5aa0-3902-4c06-9401-8bd28d639fed tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:37.113738 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-3e2a5aa0-3902-4c06-9401-8bd28d639fed tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1406 microversion: 2.20 time: 0.809724 May 27 03:41:37.114342 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 50/100] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:41:36 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1406 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:41:37.329644 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-cf955317-f1b9-4e2e-8ffe-24a52373f253 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:37.336023 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-cf955317-f1b9-4e2e-8ffe-24a52373f253 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:37.349089 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-cf955317-f1b9-4e2e-8ffe-24a52373f253 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:37.349653 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-cf955317-f1b9-4e2e-8ffe-24a52373f253 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:37.350452 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-cf955317-f1b9-4e2e-8ffe-24a52373f253 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:37.352308 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-cf955317-f1b9-4e2e-8ffe-24a52373f253 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:37.737493 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-5b40edab-c912-4bc2-bb1d-7db8eb8dba75 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:37.738404 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-5b40edab-c912-4bc2-bb1d-7db8eb8dba75 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: e3449057-b2c6-4b15-b705-4076eddfefff] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:37.747557 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-5b40edab-c912-4bc2-bb1d-7db8eb8dba75 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:37.748346 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-5b40edab-c912-4bc2-bb1d-7db8eb8dba75 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:37.749339 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-5b40edab-c912-4bc2-bb1d-7db8eb8dba75 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:37.749962 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-5b40edab-c912-4bc2-bb1d-7db8eb8dba75 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:37.826510 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-cf955317-f1b9-4e2e-8ffe-24a52373f253 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:37.836534 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-cf955317-f1b9-4e2e-8ffe-24a52373f253 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1363 microversion: 2.1 time: 0.511464 May 27 03:41:37.848703 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 51/101] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:37 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1363 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:38.040132 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-d0dde007-a5c3-4b1d-87b2-ecfd019c773d tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "766524a9-9921-40db-ae44-20cae6165dd3"}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:41:38.041742 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-d0dde007-a5c3-4b1d-87b2-ecfd019c773d tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] [instance: 5d5fdc92-2d08-4ae1-a508-032e39ce0958] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:38.073809 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d0dde007-a5c3-4b1d-87b2-ecfd019c773d tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:38.076851 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d0dde007-a5c3-4b1d-87b2-ecfd019c773d tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:38.080100 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d0dde007-a5c3-4b1d-87b2-ecfd019c773d tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:38.081910 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d0dde007-a5c3-4b1d-87b2-ecfd019c773d tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:38.554254 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-5b40edab-c912-4bc2-bb1d-7db8eb8dba75 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:38.567626 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-5b40edab-c912-4bc2-bb1d-7db8eb8dba75 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff" status: 200 len: 1322 microversion: 2.1 time: 0.834505 May 27 03:41:38.579573 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 51/102] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:37 2021] GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff => generated 1322 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:38.584759 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-5ea0dfbc-38e2-4bd1-b283-a7a483eea7d9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:38.586735 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-5ea0dfbc-38e2-4bd1-b283-a7a483eea7d9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:38.595830 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-5ea0dfbc-38e2-4bd1-b283-a7a483eea7d9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:38.596379 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-5ea0dfbc-38e2-4bd1-b283-a7a483eea7d9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:38.597252 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-5ea0dfbc-38e2-4bd1-b283-a7a483eea7d9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:38.598259 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-5ea0dfbc-38e2-4bd1-b283-a7a483eea7d9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:38.874449 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-5ea0dfbc-38e2-4bd1-b283-a7a483eea7d9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:38.886832 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-5ea0dfbc-38e2-4bd1-b283-a7a483eea7d9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:38.888367 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-5ea0dfbc-38e2-4bd1-b283-a7a483eea7d9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:38.893826 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-5ea0dfbc-38e2-4bd1-b283-a7a483eea7d9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1406 microversion: 2.20 time: 0.308685 May 27 03:41:38.903223 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 52/103] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:41:38 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1406 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:41:38.914301 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-5e03b1ea-9f05-467f-84c2-c00a404bc2fc tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:38.919580 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-5e03b1ea-9f05-467f-84c2-c00a404bc2fc tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:38.939910 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-5e03b1ea-9f05-467f-84c2-c00a404bc2fc tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:38.940364 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-5e03b1ea-9f05-467f-84c2-c00a404bc2fc tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:38.941185 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-5e03b1ea-9f05-467f-84c2-c00a404bc2fc tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:38.941649 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-5e03b1ea-9f05-467f-84c2-c00a404bc2fc tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:39.162672 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-5e03b1ea-9f05-467f-84c2-c00a404bc2fc tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:39.173201 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-5e03b1ea-9f05-467f-84c2-c00a404bc2fc tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1363 microversion: 2.1 time: 0.267328 May 27 03:41:39.174059 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 53/104] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:38 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1363 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:39.474246 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-d0dde007-a5c3-4b1d-87b2-ecfd019c773d tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] 10.222.0.25 "POST /compute/v2.1/servers/5d5fdc92-2d08-4ae1-a508-032e39ce0958/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.437999 May 27 03:41:39.474855 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 52/105] 10.222.0.25 () {60 vars in 1323 bytes} [Thu May 27 03:41:38 2021] POST /compute/v2.1/servers/5d5fdc92-2d08-4ae1-a508-032e39ce0958/os-volume_attachments => generated 194 bytes in 1440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:41:39.632970 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-1f2cf01b-e5e5-4179-91b4-67aa9ef7fafe tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:39.632970 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-1f2cf01b-e5e5-4179-91b4-67aa9ef7fafe tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: e3449057-b2c6-4b15-b705-4076eddfefff] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:39.632970 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1f2cf01b-e5e5-4179-91b4-67aa9ef7fafe tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:39.632970 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1f2cf01b-e5e5-4179-91b4-67aa9ef7fafe tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:39.634306 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1f2cf01b-e5e5-4179-91b4-67aa9ef7fafe tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:39.634306 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1f2cf01b-e5e5-4179-91b4-67aa9ef7fafe tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:39.802912 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-1f2cf01b-e5e5-4179-91b4-67aa9ef7fafe tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:39.811593 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-1f2cf01b-e5e5-4179-91b4-67aa9ef7fafe tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff" status: 200 len: 1322 microversion: 2.1 time: 0.230012 May 27 03:41:39.812189 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 54/106] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:39 2021] GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff => generated 1322 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:39.911599 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-c6e336a2-f28e-4c9c-92f1-dcce07588cd5 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:39.912293 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-c6e336a2-f28e-4c9c-92f1-dcce07588cd5 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:39.990207 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c6e336a2-f28e-4c9c-92f1-dcce07588cd5 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:39.990207 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c6e336a2-f28e-4c9c-92f1-dcce07588cd5 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:39.990207 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c6e336a2-f28e-4c9c-92f1-dcce07588cd5 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:39.990207 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c6e336a2-f28e-4c9c-92f1-dcce07588cd5 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:40.190480 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-c8d0e578-db7f-421a-a4c7-6f4005eb06c5 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:40.191096 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-c8d0e578-db7f-421a-a4c7-6f4005eb06c5 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:40.198381 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c8d0e578-db7f-421a-a4c7-6f4005eb06c5 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:40.198828 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c8d0e578-db7f-421a-a4c7-6f4005eb06c5 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:40.199594 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c8d0e578-db7f-421a-a4c7-6f4005eb06c5 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:40.200051 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c8d0e578-db7f-421a-a4c7-6f4005eb06c5 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:40.226905 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-c6e336a2-f28e-4c9c-92f1-dcce07588cd5 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:40.237046 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-c6e336a2-f28e-4c9c-92f1-dcce07588cd5 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:40.238043 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-c6e336a2-f28e-4c9c-92f1-dcce07588cd5 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:40.239274 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-c6e336a2-f28e-4c9c-92f1-dcce07588cd5 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1406 microversion: 2.20 time: 0.331819 May 27 03:41:40.240022 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 53/107] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:41:39 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1406 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:41:40.407490 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-c8d0e578-db7f-421a-a4c7-6f4005eb06c5 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:40.416021 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-c8d0e578-db7f-421a-a4c7-6f4005eb06c5 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1363 microversion: 2.1 time: 0.229626 May 27 03:41:40.416618 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 55/108] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:40 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1363 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:41:40.827834 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-e01af4bd-845d-405d-9d99-000ec5372f0b tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:40.828480 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-e01af4bd-845d-405d-9d99-000ec5372f0b tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: e3449057-b2c6-4b15-b705-4076eddfefff] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:40.836017 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e01af4bd-845d-405d-9d99-000ec5372f0b tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:40.836548 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e01af4bd-845d-405d-9d99-000ec5372f0b tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:40.837331 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e01af4bd-845d-405d-9d99-000ec5372f0b tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:40.837775 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e01af4bd-845d-405d-9d99-000ec5372f0b tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:41.059840 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-e01af4bd-845d-405d-9d99-000ec5372f0b tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:41.067906 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-e01af4bd-845d-405d-9d99-000ec5372f0b tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff" status: 200 len: 1322 microversion: 2.1 time: 0.243782 May 27 03:41:41.068486 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 54/109] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:40 2021] GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff => generated 1322 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:41.256949 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-22525b3a-0382-44a2-9556-a4f4e5c27028 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:41.257566 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-22525b3a-0382-44a2-9556-a4f4e5c27028 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:41.264654 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-22525b3a-0382-44a2-9556-a4f4e5c27028 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:41.266143 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-22525b3a-0382-44a2-9556-a4f4e5c27028 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:41.266387 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-22525b3a-0382-44a2-9556-a4f4e5c27028 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:41.266832 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-22525b3a-0382-44a2-9556-a4f4e5c27028 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:41.439177 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-7426893d-2bbe-44b4-b52f-e7946fb94eca tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:41.439860 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-7426893d-2bbe-44b4-b52f-e7946fb94eca tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:41.447143 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7426893d-2bbe-44b4-b52f-e7946fb94eca tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:41.447590 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7426893d-2bbe-44b4-b52f-e7946fb94eca tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:41.448358 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7426893d-2bbe-44b4-b52f-e7946fb94eca tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:41.448897 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7426893d-2bbe-44b4-b52f-e7946fb94eca tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:41.471458 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-22525b3a-0382-44a2-9556-a4f4e5c27028 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:41.480452 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-22525b3a-0382-44a2-9556-a4f4e5c27028 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:41.482012 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-22525b3a-0382-44a2-9556-a4f4e5c27028 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:41.483111 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-22525b3a-0382-44a2-9556-a4f4e5c27028 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1406 microversion: 2.20 time: 0.229853 May 27 03:41:41.483679 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 56/110] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:41:41 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1406 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:41:41.647959 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-7426893d-2bbe-44b4-b52f-e7946fb94eca tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:41.656795 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-7426893d-2bbe-44b4-b52f-e7946fb94eca tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1363 microversion: 2.1 time: 0.221611 May 27 03:41:41.657927 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 55/111] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:41 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1363 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:41:42.084595 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-f204300e-38c8-4ce2-a489-05c8de29c2a0 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:42.085160 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-f204300e-38c8-4ce2-a489-05c8de29c2a0 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: e3449057-b2c6-4b15-b705-4076eddfefff] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:42.092304 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f204300e-38c8-4ce2-a489-05c8de29c2a0 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:42.092797 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f204300e-38c8-4ce2-a489-05c8de29c2a0 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:42.093581 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f204300e-38c8-4ce2-a489-05c8de29c2a0 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:42.094562 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f204300e-38c8-4ce2-a489-05c8de29c2a0 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:42.290786 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-f204300e-38c8-4ce2-a489-05c8de29c2a0 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:42.299760 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-f204300e-38c8-4ce2-a489-05c8de29c2a0 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff" status: 200 len: 1322 microversion: 2.1 time: 0.218941 May 27 03:41:42.300328 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 57/112] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:42 2021] GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff => generated 1322 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:42.501359 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-2e7b002e-295a-48a2-967e-98c419eb7cdd tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:42.501896 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-2e7b002e-295a-48a2-967e-98c419eb7cdd tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:42.509507 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-2e7b002e-295a-48a2-967e-98c419eb7cdd tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:42.509959 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-2e7b002e-295a-48a2-967e-98c419eb7cdd tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:42.510720 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-2e7b002e-295a-48a2-967e-98c419eb7cdd tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:42.511156 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-2e7b002e-295a-48a2-967e-98c419eb7cdd tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:42.673722 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-cbf06d62-c537-4669-accc-18e7a7092ab7 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:42.674461 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-cbf06d62-c537-4669-accc-18e7a7092ab7 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:42.682010 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-cbf06d62-c537-4669-accc-18e7a7092ab7 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:42.682945 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-cbf06d62-c537-4669-accc-18e7a7092ab7 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:42.683153 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-cbf06d62-c537-4669-accc-18e7a7092ab7 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:42.683840 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-cbf06d62-c537-4669-accc-18e7a7092ab7 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:42.705592 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-2e7b002e-295a-48a2-967e-98c419eb7cdd tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:42.714777 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-2e7b002e-295a-48a2-967e-98c419eb7cdd tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:42.716442 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-2e7b002e-295a-48a2-967e-98c419eb7cdd tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:42.717655 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-2e7b002e-295a-48a2-967e-98c419eb7cdd tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1406 microversion: 2.20 time: 0.220089 May 27 03:41:42.718426 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 56/113] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:41:42 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1406 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:41:42.878555 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-cbf06d62-c537-4669-accc-18e7a7092ab7 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:42.886616 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-cbf06d62-c537-4669-accc-18e7a7092ab7 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1363 microversion: 2.1 time: 0.216568 May 27 03:41:42.887181 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 58/114] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:42 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1363 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:41:43.320596 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-bba5f059-dada-4877-a0a7-d0aed839bb36 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:43.320596 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-bba5f059-dada-4877-a0a7-d0aed839bb36 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: e3449057-b2c6-4b15-b705-4076eddfefff] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:43.324717 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-bba5f059-dada-4877-a0a7-d0aed839bb36 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:43.325120 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-bba5f059-dada-4877-a0a7-d0aed839bb36 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:43.325900 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-bba5f059-dada-4877-a0a7-d0aed839bb36 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:43.326352 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-bba5f059-dada-4877-a0a7-d0aed839bb36 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:43.524538 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-bba5f059-dada-4877-a0a7-d0aed839bb36 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:43.532623 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-bba5f059-dada-4877-a0a7-d0aed839bb36 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff" status: 200 len: 1322 microversion: 2.1 time: 0.220038 May 27 03:41:43.538485 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 57/115] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:43 2021] GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff => generated 1322 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:43.736967 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-be30048b-6da5-44b4-907c-dcb67f9e460b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:43.737523 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-be30048b-6da5-44b4-907c-dcb67f9e460b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:43.744532 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-be30048b-6da5-44b4-907c-dcb67f9e460b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:43.749904 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-be30048b-6da5-44b4-907c-dcb67f9e460b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:43.749904 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-be30048b-6da5-44b4-907c-dcb67f9e460b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:43.749904 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-be30048b-6da5-44b4-907c-dcb67f9e460b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:43.903150 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-62ec2e0a-6925-4da9-aae7-fcbb363aee57 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:43.903855 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-62ec2e0a-6925-4da9-aae7-fcbb363aee57 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:43.911768 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-62ec2e0a-6925-4da9-aae7-fcbb363aee57 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:43.912305 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-62ec2e0a-6925-4da9-aae7-fcbb363aee57 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:43.913202 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-62ec2e0a-6925-4da9-aae7-fcbb363aee57 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:43.913736 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-62ec2e0a-6925-4da9-aae7-fcbb363aee57 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:43.951707 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-be30048b-6da5-44b4-907c-dcb67f9e460b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:43.962758 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-be30048b-6da5-44b4-907c-dcb67f9e460b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:43.964948 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-be30048b-6da5-44b4-907c-dcb67f9e460b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:43.966359 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-be30048b-6da5-44b4-907c-dcb67f9e460b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1406 microversion: 2.20 time: 0.233838 May 27 03:41:43.967731 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 59/116] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:41:43 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1406 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:41:44.110690 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-62ec2e0a-6925-4da9-aae7-fcbb363aee57 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:44.118688 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-62ec2e0a-6925-4da9-aae7-fcbb363aee57 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1363 microversion: 2.1 time: 0.219367 May 27 03:41:44.119252 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 58/117] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:43 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1363 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:41:44.549123 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-d8759fbe-c8db-436e-85cc-15a77c09debe tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:44.549737 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-d8759fbe-c8db-436e-85cc-15a77c09debe tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: e3449057-b2c6-4b15-b705-4076eddfefff] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:44.556846 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d8759fbe-c8db-436e-85cc-15a77c09debe tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:44.557298 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d8759fbe-c8db-436e-85cc-15a77c09debe tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:44.558065 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d8759fbe-c8db-436e-85cc-15a77c09debe tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:44.558507 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d8759fbe-c8db-436e-85cc-15a77c09debe tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:44.751588 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-d8759fbe-c8db-436e-85cc-15a77c09debe tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:44.759757 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-d8759fbe-c8db-436e-85cc-15a77c09debe tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff" status: 200 len: 1322 microversion: 2.1 time: 0.214250 May 27 03:41:44.760330 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 60/118] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:44 2021] GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:44.985827 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-e577b181-7d7d-474e-a401-57358738dccb tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:44.986557 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-e577b181-7d7d-474e-a401-57358738dccb tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:44.993865 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e577b181-7d7d-474e-a401-57358738dccb tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:44.994328 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e577b181-7d7d-474e-a401-57358738dccb tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:44.995096 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e577b181-7d7d-474e-a401-57358738dccb tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:44.995545 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e577b181-7d7d-474e-a401-57358738dccb tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:45.134776 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-9f7d6655-afab-4d24-9fda-83b7ca2ba3cf tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:45.135394 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-9f7d6655-afab-4d24-9fda-83b7ca2ba3cf tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:45.142685 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-9f7d6655-afab-4d24-9fda-83b7ca2ba3cf tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:45.143132 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-9f7d6655-afab-4d24-9fda-83b7ca2ba3cf tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:45.143949 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-9f7d6655-afab-4d24-9fda-83b7ca2ba3cf tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:45.144384 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-9f7d6655-afab-4d24-9fda-83b7ca2ba3cf tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:45.194806 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-e577b181-7d7d-474e-a401-57358738dccb tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:45.203432 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-e577b181-7d7d-474e-a401-57358738dccb tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:45.205006 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-e577b181-7d7d-474e-a401-57358738dccb tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:45.206115 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-e577b181-7d7d-474e-a401-57358738dccb tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1406 microversion: 2.20 time: 0.224610 May 27 03:41:45.206719 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 59/119] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:41:44 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1406 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:41:45.339414 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-9f7d6655-afab-4d24-9fda-83b7ca2ba3cf tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:45.348295 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-9f7d6655-afab-4d24-9fda-83b7ca2ba3cf tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1363 microversion: 2.1 time: 0.217099 May 27 03:41:45.348930 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 61/120] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:45 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1363 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:41:45.776322 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-65b60c5a-b77d-4b57-863b-c69c98d95e58 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:45.776977 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-65b60c5a-b77d-4b57-863b-c69c98d95e58 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: e3449057-b2c6-4b15-b705-4076eddfefff] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:45.784905 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-65b60c5a-b77d-4b57-863b-c69c98d95e58 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:45.785366 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-65b60c5a-b77d-4b57-863b-c69c98d95e58 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:45.786144 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-65b60c5a-b77d-4b57-863b-c69c98d95e58 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:45.786588 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-65b60c5a-b77d-4b57-863b-c69c98d95e58 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:45.985513 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-65b60c5a-b77d-4b57-863b-c69c98d95e58 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:45.994427 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-65b60c5a-b77d-4b57-863b-c69c98d95e58 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff" status: 200 len: 1322 microversion: 2.1 time: 0.221754 May 27 03:41:45.995233 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 60/121] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:45 2021] GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:46.223230 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-8f545479-1b81-4d73-b969-d41e240057fd tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:46.223855 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-8f545479-1b81-4d73-b969-d41e240057fd tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:46.230934 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8f545479-1b81-4d73-b969-d41e240057fd tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:46.233100 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8f545479-1b81-4d73-b969-d41e240057fd tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:46.233100 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8f545479-1b81-4d73-b969-d41e240057fd tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:46.233100 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8f545479-1b81-4d73-b969-d41e240057fd tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:46.370999 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-ce3c5af3-62d1-4fc1-adb5-51c13c5ba3d7 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:46.371654 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-ce3c5af3-62d1-4fc1-adb5-51c13c5ba3d7 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:46.379610 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ce3c5af3-62d1-4fc1-adb5-51c13c5ba3d7 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:46.380060 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ce3c5af3-62d1-4fc1-adb5-51c13c5ba3d7 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:46.381030 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ce3c5af3-62d1-4fc1-adb5-51c13c5ba3d7 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:46.381644 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ce3c5af3-62d1-4fc1-adb5-51c13c5ba3d7 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:46.443586 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-8f545479-1b81-4d73-b969-d41e240057fd tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:46.453388 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-8f545479-1b81-4d73-b969-d41e240057fd tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:46.455265 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-8f545479-1b81-4d73-b969-d41e240057fd tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:46.456473 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-8f545479-1b81-4d73-b969-d41e240057fd tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1406 microversion: 2.20 time: 0.237064 May 27 03:41:46.457037 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 62/122] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:41:46 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1406 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:41:46.585776 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-ce3c5af3-62d1-4fc1-adb5-51c13c5ba3d7 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:46.595088 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-ce3c5af3-62d1-4fc1-adb5-51c13c5ba3d7 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1363 microversion: 2.1 time: 0.227967 May 27 03:41:46.596142 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 61/123] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:46 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1363 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:47.011746 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-52a614ca-04e3-4f52-95d8-fce369c0501a tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:47.012499 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-52a614ca-04e3-4f52-95d8-fce369c0501a tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: e3449057-b2c6-4b15-b705-4076eddfefff] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:47.020218 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-52a614ca-04e3-4f52-95d8-fce369c0501a tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:47.020820 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-52a614ca-04e3-4f52-95d8-fce369c0501a tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:47.021497 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-52a614ca-04e3-4f52-95d8-fce369c0501a tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:47.021937 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-52a614ca-04e3-4f52-95d8-fce369c0501a tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:47.231923 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-52a614ca-04e3-4f52-95d8-fce369c0501a tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:47.241910 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-52a614ca-04e3-4f52-95d8-fce369c0501a tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff" status: 200 len: 1322 microversion: 2.1 time: 0.233786 May 27 03:41:47.242704 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 63/124] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:47 2021] GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff => generated 1322 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:47.474558 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-86bba7e7-0ed0-4ae2-94e2-3802585b6160 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:47.475180 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-86bba7e7-0ed0-4ae2-94e2-3802585b6160 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:47.482341 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-86bba7e7-0ed0-4ae2-94e2-3802585b6160 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:47.482798 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-86bba7e7-0ed0-4ae2-94e2-3802585b6160 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:47.483577 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-86bba7e7-0ed0-4ae2-94e2-3802585b6160 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:47.484041 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-86bba7e7-0ed0-4ae2-94e2-3802585b6160 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:47.611289 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-f5e6e87f-1a4a-4b07-9ed9-58ce0999d3ed tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:47.611927 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-f5e6e87f-1a4a-4b07-9ed9-58ce0999d3ed tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:47.619556 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f5e6e87f-1a4a-4b07-9ed9-58ce0999d3ed tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:47.619976 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f5e6e87f-1a4a-4b07-9ed9-58ce0999d3ed tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:47.620841 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f5e6e87f-1a4a-4b07-9ed9-58ce0999d3ed tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:47.621327 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f5e6e87f-1a4a-4b07-9ed9-58ce0999d3ed tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:47.689145 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-86bba7e7-0ed0-4ae2-94e2-3802585b6160 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:47.708876 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-86bba7e7-0ed0-4ae2-94e2-3802585b6160 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:47.711024 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-86bba7e7-0ed0-4ae2-94e2-3802585b6160 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:47.714095 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-86bba7e7-0ed0-4ae2-94e2-3802585b6160 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1406 microversion: 2.20 time: 0.243262 May 27 03:41:47.717054 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 62/125] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:41:47 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1406 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:41:47.848011 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-f5e6e87f-1a4a-4b07-9ed9-58ce0999d3ed tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:47.864012 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-f5e6e87f-1a4a-4b07-9ed9-58ce0999d3ed tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1363 microversion: 2.1 time: 0.256684 May 27 03:41:47.865309 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 64/126] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:47 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1363 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:41:48.207083 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [req-6013a592-4166-40fc-89f4-60ff690aa823 req-67e22520-5c0d-4029-a147-1c7b4d1aaa94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3449057-b2c6-4b15-b705-4076eddfefff", "name": "network-vif-plugged", "status": "completed", "tag": "b78c21a4-6cab-4194-9f32-cbe141d6578d"}]} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:41:48.208972 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:41:48.208972 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: warnings.warn(msg) May 27 03:41:48.217616 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-6013a592-4166-40fc-89f4-60ff690aa823 req-67e22520-5c0d-4029-a147-1c7b4d1aaa94 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:48.218065 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-6013a592-4166-40fc-89f4-60ff690aa823 req-67e22520-5c0d-4029-a147-1c7b4d1aaa94 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:48.240168 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.compute.server_external_events [req-6013a592-4166-40fc-89f4-60ff690aa823 req-67e22520-5c0d-4029-a147-1c7b4d1aaa94 service nova] Creating event network-vif-plugged:b78c21a4-6cab-4194-9f32-cbe141d6578d for instance e3449057-b2c6-4b15-b705-4076eddfefff on hv-cinder-79326 May 27 03:41:48.242441 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-26461569-f951-4c0d-b020-ebe49082f133 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1427657937", "imageRef": "78c0913d-0e41-4b41-b38f-f45c4f2535ff", "flavorRef": "452", "networks": [{"uuid": "9d88eb5c-a234-4a0b-9721-bcab674f53e1"}]}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:41:48.247600 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [req-6013a592-4166-40fc-89f4-60ff690aa823 req-67e22520-5c0d-4029-a147-1c7b4d1aaa94 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045406 May 27 03:41:48.248206 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 63/127] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:41:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:41:48.258068 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-5ff4c875-9c71-40de-ae1b-55e631c4e855 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:48.258907 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-5ff4c875-9c71-40de-ae1b-55e631c4e855 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: e3449057-b2c6-4b15-b705-4076eddfefff] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:48.266895 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-5ff4c875-9c71-40de-ae1b-55e631c4e855 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:48.267575 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-5ff4c875-9c71-40de-ae1b-55e631c4e855 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:48.268565 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-5ff4c875-9c71-40de-ae1b-55e631c4e855 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:48.269335 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-5ff4c875-9c71-40de-ae1b-55e631c4e855 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:48.319945 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.network.neutron [None req-26461569-f951-4c0d-b020-ebe49082f133 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] validate_networks() for [('9d88eb5c-a234-4a0b-9721-bcab674f53e1', None, None, None)] {{(pid=113021) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 27 03:41:48.541608 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-5ff4c875-9c71-40de-ae1b-55e631c4e855 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:48.556592 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-5ff4c875-9c71-40de-ae1b-55e631c4e855 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff" status: 200 len: 1322 microversion: 2.1 time: 0.302235 May 27 03:41:48.557958 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 64/128] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:48 2021] GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff => generated 1322 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:41:48.735200 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-31cd3d96-66bc-4a1c-8903-a03899666562 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:48.736075 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-31cd3d96-66bc-4a1c-8903-a03899666562 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:48.746101 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-31cd3d96-66bc-4a1c-8903-a03899666562 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:48.746775 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-31cd3d96-66bc-4a1c-8903-a03899666562 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:48.747938 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-31cd3d96-66bc-4a1c-8903-a03899666562 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:48.748606 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-31cd3d96-66bc-4a1c-8903-a03899666562 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:49.043563 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-31cd3d96-66bc-4a1c-8903-a03899666562 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:49.060022 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-31cd3d96-66bc-4a1c-8903-a03899666562 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:49.060022 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-31cd3d96-66bc-4a1c-8903-a03899666562 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:49.060022 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-31cd3d96-66bc-4a1c-8903-a03899666562 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1406 microversion: 2.20 time: 0.328895 May 27 03:41:49.071325 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 65/129] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:41:48 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1406 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:41:49.076026 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-2ab88d39-7c3f-4327-98db-eb18431ff7d0 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:49.076844 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-2ab88d39-7c3f-4327-98db-eb18431ff7d0 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:49.090845 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-2ab88d39-7c3f-4327-98db-eb18431ff7d0 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:49.091316 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-2ab88d39-7c3f-4327-98db-eb18431ff7d0 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:49.095529 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-2ab88d39-7c3f-4327-98db-eb18431ff7d0 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:49.095997 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-2ab88d39-7c3f-4327-98db-eb18431ff7d0 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:49.281711 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.virt.hardware [None req-26461569-f951-4c0d-b020-ebe49082f133 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Flavor limits 0:0:0 {{(pid=113021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 27 03:41:49.283698 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.virt.hardware [None req-26461569-f951-4c0d-b020-ebe49082f133 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Image limits 0:0:0 {{(pid=113021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 27 03:41:49.283698 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.virt.hardware [None req-26461569-f951-4c0d-b020-ebe49082f133 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Flavor pref 0:0:0 {{(pid=113021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 27 03:41:49.284318 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.virt.hardware [None req-26461569-f951-4c0d-b020-ebe49082f133 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Image pref 0:0:0 {{(pid=113021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 27 03:41:49.285509 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.virt.hardware [None req-26461569-f951-4c0d-b020-ebe49082f133 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=113021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 27 03:41:49.305991 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-26461569-f951-4c0d-b020-ebe49082f133 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:49.306570 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-26461569-f951-4c0d-b020-ebe49082f133 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:49.307648 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-26461569-f951-4c0d-b020-ebe49082f133 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:49.308440 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-26461569-f951-4c0d-b020-ebe49082f133 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:49.323676 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-2ab88d39-7c3f-4327-98db-eb18431ff7d0 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:49.327580 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.quota [None req-26461569-f951-4c0d-b020-ebe49082f133 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Getting quotas for project 7413f58ffa8e476fb5600cbc51ee9d34. Resources: {'instances', 'cores', 'ram'} {{(pid=113021) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 27 03:41:49.331888 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.quota [None req-26461569-f951-4c0d-b020-ebe49082f133 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Getting quotas for user 925b5b18987f4e1eac67fda030a1714a and project 7413f58ffa8e476fb5600cbc51ee9d34. Resources: {'instances', 'cores', 'ram'} {{(pid=113021) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 27 03:41:49.339617 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-2ab88d39-7c3f-4327-98db-eb18431ff7d0 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1363 microversion: 2.1 time: 0.266984 May 27 03:41:49.340479 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 66/130] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:49 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1363 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:49.352804 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-26461569-f951-4c0d-b020-ebe49082f133 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Going to run 1 instances... {{(pid=113021) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 27 03:41:49.355146 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-26461569-f951-4c0d-b020-ebe49082f133 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 6a78b67b-ae82-47f7-9c4a-3698918592c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78c0913d-0e41-4b41-b38f-f45c4f2535ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=113021) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 27 03:41:49.568884 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-26461569-f951-4c0d-b020-ebe49082f133 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.330019 May 27 03:41:49.569470 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 65/131] 10.222.0.25 () {60 vars in 1147 bytes} [Thu May 27 03:41:48 2021] POST /compute/v2.1/servers => generated 380 bytes in 1331 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 27 03:41:49.574392 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-78e1a202-98cb-4181-bcb0-7aa3db4ed9bf tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:49.575001 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-78e1a202-98cb-4181-bcb0-7aa3db4ed9bf tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: e3449057-b2c6-4b15-b705-4076eddfefff] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:49.583500 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-78e1a202-98cb-4181-bcb0-7aa3db4ed9bf tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:49.584369 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-78e1a202-98cb-4181-bcb0-7aa3db4ed9bf tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:49.585572 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-78e1a202-98cb-4181-bcb0-7aa3db4ed9bf tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:49.586020 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-78e1a202-98cb-4181-bcb0-7aa3db4ed9bf tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:49.595538 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-10ede18a-ec72-4c2e-84a4-5b7ce97d2c60 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:49.596120 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-10ede18a-ec72-4c2e-84a4-5b7ce97d2c60 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 6a78b67b-ae82-47f7-9c4a-3698918592c6] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:49.666486 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-10ede18a-ec72-4c2e-84a4-5b7ce97d2c60 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:49.693167 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-10ede18a-ec72-4c2e-84a4-5b7ce97d2c60 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/6a78b67b-ae82-47f7-9c4a-3698918592c6" status: 200 len: 1218 microversion: 2.1 time: 0.112658 May 27 03:41:49.698250 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 66/132] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:49 2021] GET /compute/v2.1/servers/6a78b67b-ae82-47f7-9c4a-3698918592c6 => generated 1218 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:49.816568 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-78e1a202-98cb-4181-bcb0-7aa3db4ed9bf tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:49.833458 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-78e1a202-98cb-4181-bcb0-7aa3db4ed9bf tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff" status: 200 len: 1322 microversion: 2.1 time: 0.255141 May 27 03:41:49.833458 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 67/133] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:49 2021] GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff => generated 1322 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:50.078409 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-f2df05f8-923e-4f3d-8f85-4dfb3c5f00aa tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:50.079024 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-f2df05f8-923e-4f3d-8f85-4dfb3c5f00aa tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:50.086274 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f2df05f8-923e-4f3d-8f85-4dfb3c5f00aa tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:50.086670 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f2df05f8-923e-4f3d-8f85-4dfb3c5f00aa tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:50.087432 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f2df05f8-923e-4f3d-8f85-4dfb3c5f00aa tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:50.087865 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f2df05f8-923e-4f3d-8f85-4dfb3c5f00aa tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:50.261445 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [req-be861d55-2535-4e01-a8cf-9657fbb57ac9 req-70943b0c-8914-498a-82a1-2e20c28329a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0", "name": "network-vif-plugged", "status": "completed", "tag": "3f12ac65-af0d-4c74-bfa1-375cddc42ae8"}, {"server_uuid": "3c7e656a-afc5-4119-a11e-920c583d89d2", "name": "network-vif-plugged", "status": "completed", "tag": "24177437-ade1-43c7-bd7d-340757426924"}]} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:41:50.263264 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:41:50.263264 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: warnings.warn(msg) May 27 03:41:50.273302 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-be861d55-2535-4e01-a8cf-9657fbb57ac9 req-70943b0c-8914-498a-82a1-2e20c28329a1 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:50.274052 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-be861d55-2535-4e01-a8cf-9657fbb57ac9 req-70943b0c-8914-498a-82a1-2e20c28329a1 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:50.297145 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.compute.server_external_events [req-be861d55-2535-4e01-a8cf-9657fbb57ac9 req-70943b0c-8914-498a-82a1-2e20c28329a1 service nova] Creating event network-vif-plugged:3f12ac65-af0d-4c74-bfa1-375cddc42ae8 for instance 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0 on hv-cinder-79326 May 27 03:41:50.297936 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.compute.server_external_events [req-be861d55-2535-4e01-a8cf-9657fbb57ac9 req-70943b0c-8914-498a-82a1-2e20c28329a1 service nova] Creating event network-vif-plugged:24177437-ade1-43c7-bd7d-340757426924 for instance 3c7e656a-afc5-4119-a11e-920c583d89d2 on hv-cinder-79326 May 27 03:41:50.304034 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-f2df05f8-923e-4f3d-8f85-4dfb3c5f00aa tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:50.306261 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [req-be861d55-2535-4e01-a8cf-9657fbb57ac9 req-70943b0c-8914-498a-82a1-2e20c28329a1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.048430 May 27 03:41:50.307950 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 68/134] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:41:50 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:41:50.313605 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-f2df05f8-923e-4f3d-8f85-4dfb3c5f00aa tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:50.315200 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-f2df05f8-923e-4f3d-8f85-4dfb3c5f00aa tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:50.316284 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-f2df05f8-923e-4f3d-8f85-4dfb3c5f00aa tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1406 microversion: 2.20 time: 0.242157 May 27 03:41:50.316864 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 67/135] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:41:50 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1406 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:41:50.358059 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-37361955-f9f1-4510-b631-d431329c2d36 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:50.358834 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-37361955-f9f1-4510-b631-d431329c2d36 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:50.366694 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-37361955-f9f1-4510-b631-d431329c2d36 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:50.367283 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-37361955-f9f1-4510-b631-d431329c2d36 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:50.369366 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-37361955-f9f1-4510-b631-d431329c2d36 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:50.369932 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-37361955-f9f1-4510-b631-d431329c2d36 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:50.581148 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-37361955-f9f1-4510-b631-d431329c2d36 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:50.594644 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-37361955-f9f1-4510-b631-d431329c2d36 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1363 microversion: 2.1 time: 0.241119 May 27 03:41:50.595261 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 69/136] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:50 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1363 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:50.709964 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-68443759-73c7-496a-b525-fe6271f4cc88 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:50.711632 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-68443759-73c7-496a-b525-fe6271f4cc88 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 6a78b67b-ae82-47f7-9c4a-3698918592c6] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:50.719709 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-68443759-73c7-496a-b525-fe6271f4cc88 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:50.720354 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-68443759-73c7-496a-b525-fe6271f4cc88 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:50.721294 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-68443759-73c7-496a-b525-fe6271f4cc88 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:50.721896 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-68443759-73c7-496a-b525-fe6271f4cc88 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:50.850904 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-1faca04b-9c35-4282-abda-80cc01bcd62a tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:50.852057 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-1faca04b-9c35-4282-abda-80cc01bcd62a tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: e3449057-b2c6-4b15-b705-4076eddfefff] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:50.862911 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1faca04b-9c35-4282-abda-80cc01bcd62a tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:50.870570 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1faca04b-9c35-4282-abda-80cc01bcd62a tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:50.870570 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1faca04b-9c35-4282-abda-80cc01bcd62a tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:50.870570 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1faca04b-9c35-4282-abda-80cc01bcd62a tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:50.889114 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-68443759-73c7-496a-b525-fe6271f4cc88 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:50.899599 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-68443759-73c7-496a-b525-fe6271f4cc88 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/6a78b67b-ae82-47f7-9c4a-3698918592c6" status: 200 len: 1222 microversion: 2.1 time: 0.193571 May 27 03:41:50.901265 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 68/137] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:50 2021] GET /compute/v2.1/servers/6a78b67b-ae82-47f7-9c4a-3698918592c6 => generated 1222 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:51.132382 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-1faca04b-9c35-4282-abda-80cc01bcd62a tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:51.140529 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-1faca04b-9c35-4282-abda-80cc01bcd62a tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff" status: 200 len: 1322 microversion: 2.1 time: 0.295799 May 27 03:41:51.141088 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 70/138] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:50 2021] GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff => generated 1322 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:41:51.336187 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-2e1c17cf-6839-414f-9e92-5d5dbbcaa3da tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:51.336991 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-2e1c17cf-6839-414f-9e92-5d5dbbcaa3da tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:51.344962 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2e1c17cf-6839-414f-9e92-5d5dbbcaa3da tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:51.345416 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2e1c17cf-6839-414f-9e92-5d5dbbcaa3da tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:51.346187 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2e1c17cf-6839-414f-9e92-5d5dbbcaa3da tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:51.346654 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2e1c17cf-6839-414f-9e92-5d5dbbcaa3da tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:51.548067 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-2e1c17cf-6839-414f-9e92-5d5dbbcaa3da tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:51.556820 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-2e1c17cf-6839-414f-9e92-5d5dbbcaa3da tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:51.558348 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-2e1c17cf-6839-414f-9e92-5d5dbbcaa3da tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:51.559428 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-2e1c17cf-6839-414f-9e92-5d5dbbcaa3da tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1406 microversion: 2.20 time: 0.227082 May 27 03:41:51.559984 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 69/139] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:41:51 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1406 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:41:51.611670 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-c3aa013d-8360-4a18-8019-437ea0fee314 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:51.612864 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-c3aa013d-8360-4a18-8019-437ea0fee314 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:51.619995 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c3aa013d-8360-4a18-8019-437ea0fee314 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:51.620482 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c3aa013d-8360-4a18-8019-437ea0fee314 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:51.621282 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c3aa013d-8360-4a18-8019-437ea0fee314 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:51.621883 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c3aa013d-8360-4a18-8019-437ea0fee314 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:51.844927 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-c3aa013d-8360-4a18-8019-437ea0fee314 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:51.853458 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-c3aa013d-8360-4a18-8019-437ea0fee314 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1363 microversion: 2.1 time: 0.245639 May 27 03:41:51.854038 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 71/140] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:51 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1363 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:51.916881 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-e5e0dda2-0ec8-4c88-bd9a-cc73e171e388 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:51.917418 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-e5e0dda2-0ec8-4c88-bd9a-cc73e171e388 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 6a78b67b-ae82-47f7-9c4a-3698918592c6] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:51.925026 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e5e0dda2-0ec8-4c88-bd9a-cc73e171e388 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:51.925490 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e5e0dda2-0ec8-4c88-bd9a-cc73e171e388 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:51.926269 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e5e0dda2-0ec8-4c88-bd9a-cc73e171e388 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:51.926711 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e5e0dda2-0ec8-4c88-bd9a-cc73e171e388 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:52.043697 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-e5e0dda2-0ec8-4c88-bd9a-cc73e171e388 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:52.052842 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-e5e0dda2-0ec8-4c88-bd9a-cc73e171e388 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/6a78b67b-ae82-47f7-9c4a-3698918592c6" status: 200 len: 1270 microversion: 2.1 time: 0.139507 May 27 03:41:52.053624 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 70/141] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:51 2021] GET /compute/v2.1/servers/6a78b67b-ae82-47f7-9c4a-3698918592c6 => generated 1270 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:41:52.167286 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-24102ad2-f6d4-4f65-b7a7-d3ace82f83d5 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:52.168383 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-24102ad2-f6d4-4f65-b7a7-d3ace82f83d5 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: e3449057-b2c6-4b15-b705-4076eddfefff] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:52.189281 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-24102ad2-f6d4-4f65-b7a7-d3ace82f83d5 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:52.189961 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-24102ad2-f6d4-4f65-b7a7-d3ace82f83d5 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:52.191131 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-24102ad2-f6d4-4f65-b7a7-d3ace82f83d5 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:52.192238 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-24102ad2-f6d4-4f65-b7a7-d3ace82f83d5 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:52.325642 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [req-94ff7d41-3ff4-4ac6-89cd-8982ae011be9 req-d1b36d32-14aa-44f1-b5c5-9300d4b67d43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e367eb4b-29c5-4f41-b41d-0da84d751fe2", "name": "network-vif-plugged", "status": "completed", "tag": "396ee32c-72a8-43ea-b35c-f0de6de19d7a"}]} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:41:52.327585 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:41:52.327585 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: warnings.warn(msg) May 27 03:41:52.356282 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-94ff7d41-3ff4-4ac6-89cd-8982ae011be9 req-d1b36d32-14aa-44f1-b5c5-9300d4b67d43 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:52.357460 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-94ff7d41-3ff4-4ac6-89cd-8982ae011be9 req-d1b36d32-14aa-44f1-b5c5-9300d4b67d43 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:52.385159 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.compute.server_external_events [req-94ff7d41-3ff4-4ac6-89cd-8982ae011be9 req-d1b36d32-14aa-44f1-b5c5-9300d4b67d43 service nova] Creating event network-vif-plugged:396ee32c-72a8-43ea-b35c-f0de6de19d7a for instance e367eb4b-29c5-4f41-b41d-0da84d751fe2 on hv-cinder-79326 May 27 03:41:52.390359 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [req-94ff7d41-3ff4-4ac6-89cd-8982ae011be9 req-d1b36d32-14aa-44f1-b5c5-9300d4b67d43 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069180 May 27 03:41:52.392771 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 71/142] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:41:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:41:52.488505 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-24102ad2-f6d4-4f65-b7a7-d3ace82f83d5 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:52.496896 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-24102ad2-f6d4-4f65-b7a7-d3ace82f83d5 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff" status: 200 len: 1517 microversion: 2.1 time: 0.343086 May 27 03:41:52.497672 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 72/143] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:52 2021] GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff => generated 1517 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:52.515916 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-0033f49c-88a2-4d33-9a83-20ee3d3b21e1 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:41:52.517272 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-0033f49c-88a2-4d33-9a83-20ee3d3b21e1 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: e3449057-b2c6-4b15-b705-4076eddfefff] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:52.525069 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-0033f49c-88a2-4d33-9a83-20ee3d3b21e1 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:52.525798 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-0033f49c-88a2-4d33-9a83-20ee3d3b21e1 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:52.526742 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-0033f49c-88a2-4d33-9a83-20ee3d3b21e1 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:52.527334 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-0033f49c-88a2-4d33-9a83-20ee3d3b21e1 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:52.577957 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-c133de94-5c93-4b34-8ab6-02b8d2ceb396 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:52.584462 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-c133de94-5c93-4b34-8ab6-02b8d2ceb396 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:52.592540 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c133de94-5c93-4b34-8ab6-02b8d2ceb396 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:52.592980 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c133de94-5c93-4b34-8ab6-02b8d2ceb396 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:52.594297 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c133de94-5c93-4b34-8ab6-02b8d2ceb396 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:52.594730 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c133de94-5c93-4b34-8ab6-02b8d2ceb396 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:52.598466 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.objects.instance [None req-0033f49c-88a2-4d33-9a83-20ee3d3b21e1 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lazy-loading 'flavor' on Instance uuid e3449057-b2c6-4b15-b705-4076eddfefff {{(pid=113021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 27 03:41:52.995314 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-c133de94-5c93-4b34-8ab6-02b8d2ceb396 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:53.002081 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-0033f49c-88a2-4d33-9a83-20ee3d3b21e1 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "POST /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff/action" status: 200 len: 32 microversion: 2.1 time: 0.487920 May 27 03:41:53.007846 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 72/144] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:41:52 2021] POST /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff/action => generated 32 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 03:41:53.014145 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-c133de94-5c93-4b34-8ab6-02b8d2ceb396 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:53.018398 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-c133de94-5c93-4b34-8ab6-02b8d2ceb396 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:53.022830 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-c133de94-5c93-4b34-8ab6-02b8d2ceb396 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1406 microversion: 2.20 time: 0.448693 May 27 03:41:53.024380 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-ce4bf580-c418-4793-8870-6945a17de4e5 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:53.024676 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 73/145] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:41:52 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1406 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:41:53.027718 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-ce4bf580-c418-4793-8870-6945a17de4e5 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:53.037137 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-6c8e3c16-c94b-4d94-bf7b-2e2b4d2a00b2 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:53.038002 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-6c8e3c16-c94b-4d94-bf7b-2e2b4d2a00b2 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: e3449057-b2c6-4b15-b705-4076eddfefff] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:53.051598 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6c8e3c16-c94b-4d94-bf7b-2e2b4d2a00b2 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:53.052959 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6c8e3c16-c94b-4d94-bf7b-2e2b4d2a00b2 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:53.055908 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6c8e3c16-c94b-4d94-bf7b-2e2b4d2a00b2 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:53.056423 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6c8e3c16-c94b-4d94-bf7b-2e2b4d2a00b2 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:53.087327 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ce4bf580-c418-4793-8870-6945a17de4e5 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:53.087981 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ce4bf580-c418-4793-8870-6945a17de4e5 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:53.088978 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ce4bf580-c418-4793-8870-6945a17de4e5 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:53.095163 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ce4bf580-c418-4793-8870-6945a17de4e5 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:53.511316 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-6c8e3c16-c94b-4d94-bf7b-2e2b4d2a00b2 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:53.519732 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-6c8e3c16-c94b-4d94-bf7b-2e2b4d2a00b2 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff" status: 200 len: 1523 microversion: 2.1 time: 0.494219 May 27 03:41:53.520425 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 74/146] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:53 2021] GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff => generated 1523 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:53.524967 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-a496e52c-2805-4fad-8578-52dbc081f254 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:53.525903 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-a496e52c-2805-4fad-8578-52dbc081f254 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 6a78b67b-ae82-47f7-9c4a-3698918592c6] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:53.533978 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a496e52c-2805-4fad-8578-52dbc081f254 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:53.534357 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a496e52c-2805-4fad-8578-52dbc081f254 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:53.535193 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a496e52c-2805-4fad-8578-52dbc081f254 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:53.535629 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a496e52c-2805-4fad-8578-52dbc081f254 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:53.651022 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-a496e52c-2805-4fad-8578-52dbc081f254 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:53.660211 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-a496e52c-2805-4fad-8578-52dbc081f254 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/6a78b67b-ae82-47f7-9c4a-3698918592c6" status: 200 len: 1276 microversion: 2.1 time: 0.138540 May 27 03:41:53.660819 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 75/147] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:53 2021] GET /compute/v2.1/servers/6a78b67b-ae82-47f7-9c4a-3698918592c6 => generated 1276 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:53.822516 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-ce4bf580-c418-4793-8870-6945a17de4e5 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:53.833322 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-ce4bf580-c418-4793-8870-6945a17de4e5 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1363 microversion: 2.1 time: 0.824394 May 27 03:41:53.834194 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 73/148] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:53 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1363 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:54.047477 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-3947dc9c-e788-433b-8490-2e33e8f7e0b4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:54.048033 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-3947dc9c-e788-433b-8490-2e33e8f7e0b4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:54.055966 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3947dc9c-e788-433b-8490-2e33e8f7e0b4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:54.056624 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3947dc9c-e788-433b-8490-2e33e8f7e0b4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:54.057822 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3947dc9c-e788-433b-8490-2e33e8f7e0b4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:54.058398 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3947dc9c-e788-433b-8490-2e33e8f7e0b4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:54.354461 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-3947dc9c-e788-433b-8490-2e33e8f7e0b4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:54.381447 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-3947dc9c-e788-433b-8490-2e33e8f7e0b4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:54.384572 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-3947dc9c-e788-433b-8490-2e33e8f7e0b4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:54.386258 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-3947dc9c-e788-433b-8490-2e33e8f7e0b4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1406 microversion: 2.20 time: 0.342542 May 27 03:41:54.399072 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 76/149] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:41:54 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1406 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:41:54.536104 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-b9ea3fd2-f531-4361-9f26-9a2ecec89d79 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:54.537269 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-b9ea3fd2-f531-4361-9f26-9a2ecec89d79 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: e3449057-b2c6-4b15-b705-4076eddfefff] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:54.545302 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b9ea3fd2-f531-4361-9f26-9a2ecec89d79 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:54.546151 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b9ea3fd2-f531-4361-9f26-9a2ecec89d79 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:54.548515 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b9ea3fd2-f531-4361-9f26-9a2ecec89d79 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:54.549767 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b9ea3fd2-f531-4361-9f26-9a2ecec89d79 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:54.679240 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-1d009139-8983-4214-9efc-ce0203f78025 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:54.679868 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-1d009139-8983-4214-9efc-ce0203f78025 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 6a78b67b-ae82-47f7-9c4a-3698918592c6] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:54.689045 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1d009139-8983-4214-9efc-ce0203f78025 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:54.689495 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1d009139-8983-4214-9efc-ce0203f78025 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:54.690445 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1d009139-8983-4214-9efc-ce0203f78025 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:54.691036 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1d009139-8983-4214-9efc-ce0203f78025 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:54.943525 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-1d009139-8983-4214-9efc-ce0203f78025 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:54.965745 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-1d009139-8983-4214-9efc-ce0203f78025 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/6a78b67b-ae82-47f7-9c4a-3698918592c6" status: 200 len: 1318 microversion: 2.1 time: 0.291312 May 27 03:41:54.966336 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 77/150] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:54 2021] GET /compute/v2.1/servers/6a78b67b-ae82-47f7-9c4a-3698918592c6 => generated 1318 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:54.979820 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-d30b0cd9-4954-4744-95bd-f262f60a350b tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:54.990932 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-d30b0cd9-4954-4744-95bd-f262f60a350b tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:55.004752 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d30b0cd9-4954-4744-95bd-f262f60a350b tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:55.005209 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d30b0cd9-4954-4744-95bd-f262f60a350b tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:55.008754 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d30b0cd9-4954-4744-95bd-f262f60a350b tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:55.009387 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d30b0cd9-4954-4744-95bd-f262f60a350b tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:55.011149 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-b9ea3fd2-f531-4361-9f26-9a2ecec89d79 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:55.026454 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-b9ea3fd2-f531-4361-9f26-9a2ecec89d79 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff" status: 200 len: 1523 microversion: 2.1 time: 0.494005 May 27 03:41:55.027115 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 74/151] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:54 2021] GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff => generated 1523 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:55.271202 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-d30b0cd9-4954-4744-95bd-f262f60a350b tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:55.280006 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-d30b0cd9-4954-4744-95bd-f262f60a350b tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1548 microversion: 2.1 time: 0.311854 May 27 03:41:55.280740 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 78/152] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:54 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1548 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:55.297597 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-12fad626-94bd-4d0e-b317-59069f0b6930 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:55.298382 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-12fad626-94bd-4d0e-b317-59069f0b6930 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:55.305945 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-12fad626-94bd-4d0e-b317-59069f0b6930 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:55.306392 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-12fad626-94bd-4d0e-b317-59069f0b6930 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:55.307355 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-12fad626-94bd-4d0e-b317-59069f0b6930 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:55.307935 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-12fad626-94bd-4d0e-b317-59069f0b6930 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:55.404820 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-0ff17479-8f7e-4303-a4f3-b27d35e0102c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:55.405433 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-0ff17479-8f7e-4303-a4f3-b27d35e0102c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:55.420000 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0ff17479-8f7e-4303-a4f3-b27d35e0102c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:55.420422 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0ff17479-8f7e-4303-a4f3-b27d35e0102c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:55.421834 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0ff17479-8f7e-4303-a4f3-b27d35e0102c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:55.422422 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0ff17479-8f7e-4303-a4f3-b27d35e0102c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:55.666296 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-0ff17479-8f7e-4303-a4f3-b27d35e0102c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:55.684543 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-0ff17479-8f7e-4303-a4f3-b27d35e0102c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:55.687696 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-0ff17479-8f7e-4303-a4f3-b27d35e0102c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:55.689546 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-0ff17479-8f7e-4303-a4f3-b27d35e0102c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1406 microversion: 2.20 time: 0.288421 May 27 03:41:55.690568 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 79/153] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:41:55 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1406 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:41:55.695571 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-f1a31177-9e34-4533-a985-a4a520347fbe tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:55.696393 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-f1a31177-9e34-4533-a985-a4a520347fbe tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] [instance: 5d5fdc92-2d08-4ae1-a508-032e39ce0958] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:55.704980 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f1a31177-9e34-4533-a985-a4a520347fbe tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:55.710433 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f1a31177-9e34-4533-a985-a4a520347fbe tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:55.710433 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f1a31177-9e34-4533-a985-a4a520347fbe tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:55.710433 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f1a31177-9e34-4533-a985-a4a520347fbe tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:55.780292 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-f1a31177-9e34-4533-a985-a4a520347fbe tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] [instance: 5d5fdc92-2d08-4ae1-a508-032e39ce0958] Going to try to terminate instance {{(pid=113020) delete /opt/stack/nova/nova/compute/api.py:2539}} May 27 03:41:55.809303 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-12fad626-94bd-4d0e-b317-59069f0b6930 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.513632 May 27 03:41:55.809303 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 75/154] 10.222.0.25 () {58 vars in 1275 bytes} [Thu May 27 03:41:55 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/os-interface => generated 284 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:41:55.984542 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-d7656b23-00c1-408f-a8f8-9af137d69fab tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:55.985358 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-d7656b23-00c1-408f-a8f8-9af137d69fab tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 6a78b67b-ae82-47f7-9c4a-3698918592c6] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:55.994342 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d7656b23-00c1-408f-a8f8-9af137d69fab tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:55.994995 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d7656b23-00c1-408f-a8f8-9af137d69fab tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:55.995942 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d7656b23-00c1-408f-a8f8-9af137d69fab tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:55.996693 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d7656b23-00c1-408f-a8f8-9af137d69fab tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:56.112889 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-f1a31177-9e34-4533-a985-a4a520347fbe tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5d5fdc92-2d08-4ae1-a508-032e39ce0958" status: 204 len: 0 microversion: 2.1 time: 0.420392 May 27 03:41:56.113649 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 80/155] 10.222.0.25 () {58 vars in 1239 bytes} [Thu May 27 03:41:55 2021] DELETE /compute/v2.1/servers/5d5fdc92-2d08-4ae1-a508-032e39ce0958 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 03:41:56.122930 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-3d58e882-5a98-4a92-b5d2-88e4e2471459 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:56.124102 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-3d58e882-5a98-4a92-b5d2-88e4e2471459 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: e3449057-b2c6-4b15-b705-4076eddfefff] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:56.134290 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3d58e882-5a98-4a92-b5d2-88e4e2471459 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:56.134890 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3d58e882-5a98-4a92-b5d2-88e4e2471459 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:56.135701 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3d58e882-5a98-4a92-b5d2-88e4e2471459 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:56.136142 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3d58e882-5a98-4a92-b5d2-88e4e2471459 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:56.536643 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-3d58e882-5a98-4a92-b5d2-88e4e2471459 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:56.547061 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-3d58e882-5a98-4a92-b5d2-88e4e2471459 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff" status: 200 len: 1523 microversion: 2.1 time: 0.427876 May 27 03:41:56.556636 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 81/156] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:56 2021] GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff => generated 1523 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:56.556636 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-474dd359-27f5-4f24-9d4f-64a8fe63e0f1 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:56.556636 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-474dd359-27f5-4f24-9d4f-64a8fe63e0f1 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] [instance: 5d5fdc92-2d08-4ae1-a508-032e39ce0958] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:56.561928 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-474dd359-27f5-4f24-9d4f-64a8fe63e0f1 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:56.562490 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-474dd359-27f5-4f24-9d4f-64a8fe63e0f1 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:56.563366 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-474dd359-27f5-4f24-9d4f-64a8fe63e0f1 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:56.563895 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-474dd359-27f5-4f24-9d4f-64a8fe63e0f1 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:56.808544 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-474dd359-27f5-4f24-9d4f-64a8fe63e0f1 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0207569193c64a2abbb1ae8f857d41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f220b161db454279a529469cc181cb86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:56.821164 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-474dd359-27f5-4f24-9d4f-64a8fe63e0f1 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] 10.222.0.25 "GET /compute/v2.1/servers/5d5fdc92-2d08-4ae1-a508-032e39ce0958" status: 200 len: 1554 microversion: 2.1 time: 0.272043 May 27 03:41:56.822257 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 82/157] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:56 2021] GET /compute/v2.1/servers/5d5fdc92-2d08-4ae1-a508-032e39ce0958 => generated 1554 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:56.830513 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [req-ce3bfb2b-b8ce-4d5c-8a4e-a293c1e980ab req-05efe9cc-97df-48ef-99b4-2df91e6bea29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a78b67b-ae82-47f7-9c4a-3698918592c6", "tag": "7c9d543c-8635-48f1-aa64-5b32d4b0b972"}]} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:41:56.832113 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:41:56.832113 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: warnings.warn(msg) May 27 03:41:56.846372 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-ce3bfb2b-b8ce-4d5c-8a4e-a293c1e980ab req-05efe9cc-97df-48ef-99b4-2df91e6bea29 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:56.847277 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-ce3bfb2b-b8ce-4d5c-8a4e-a293c1e980ab req-05efe9cc-97df-48ef-99b4-2df91e6bea29 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:56.864392 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.compute.server_external_events [req-ce3bfb2b-b8ce-4d5c-8a4e-a293c1e980ab req-05efe9cc-97df-48ef-99b4-2df91e6bea29 service nova] Creating event network-changed:7c9d543c-8635-48f1-aa64-5b32d4b0b972 for instance 6a78b67b-ae82-47f7-9c4a-3698918592c6 on hv-cinder-79326 May 27 03:41:56.870173 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [req-ce3bfb2b-b8ce-4d5c-8a4e-a293c1e980ab req-05efe9cc-97df-48ef-99b4-2df91e6bea29 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046145 May 27 03:41:56.870903 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 83/158] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:41:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:41:56.877418 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-da18292b-ac18-4b27-8c61-0e334aa6f16b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:56.878269 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-da18292b-ac18-4b27-8c61-0e334aa6f16b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:56.886127 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-da18292b-ac18-4b27-8c61-0e334aa6f16b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:56.886817 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-da18292b-ac18-4b27-8c61-0e334aa6f16b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:56.887853 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-da18292b-ac18-4b27-8c61-0e334aa6f16b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:56.888522 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-da18292b-ac18-4b27-8c61-0e334aa6f16b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:57.088567 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-d7656b23-00c1-408f-a8f8-9af137d69fab tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:57.106626 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-d7656b23-00c1-408f-a8f8-9af137d69fab tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/6a78b67b-ae82-47f7-9c4a-3698918592c6" status: 200 len: 1318 microversion: 2.1 time: 1.126852 May 27 03:41:57.109994 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 76/159] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:55 2021] GET /compute/v2.1/servers/6a78b67b-ae82-47f7-9c4a-3698918592c6 => generated 1318 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:41:57.165502 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-da18292b-ac18-4b27-8c61-0e334aa6f16b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:57.175995 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-da18292b-ac18-4b27-8c61-0e334aa6f16b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:57.177648 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-da18292b-ac18-4b27-8c61-0e334aa6f16b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:57.178806 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-da18292b-ac18-4b27-8c61-0e334aa6f16b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1598 microversion: 2.20 time: 0.306263 May 27 03:41:57.179363 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 84/160] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:41:56 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1598 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:41:57.197026 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-074f02f6-4f27-4c19-866d-e8948a16cefb tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:57.197800 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-074f02f6-4f27-4c19-866d-e8948a16cefb tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:57.206474 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-074f02f6-4f27-4c19-866d-e8948a16cefb tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:57.207139 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-074f02f6-4f27-4c19-866d-e8948a16cefb tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:57.208688 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-074f02f6-4f27-4c19-866d-e8948a16cefb tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:57.209194 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-074f02f6-4f27-4c19-866d-e8948a16cefb tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:57.568585 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-798d84f0-fd4f-4bba-be41-39769bcd4bba tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:57.570574 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-798d84f0-fd4f-4bba-be41-39769bcd4bba tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: e3449057-b2c6-4b15-b705-4076eddfefff] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:57.581002 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-798d84f0-fd4f-4bba-be41-39769bcd4bba tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:57.582186 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-798d84f0-fd4f-4bba-be41-39769bcd4bba tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:57.583452 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-798d84f0-fd4f-4bba-be41-39769bcd4bba tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:57.584112 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-798d84f0-fd4f-4bba-be41-39769bcd4bba tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:57.589415 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-074f02f6-4f27-4c19-866d-e8948a16cefb tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.396005 May 27 03:41:57.599892 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 77/161] 10.222.0.25 () {60 vars in 1316 bytes} [Thu May 27 03:41:57 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/os-interface => generated 284 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:41:57.838860 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-842c2a21-50b5-44c4-8151-ca4e9550feb5 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:57.839805 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-842c2a21-50b5-44c4-8151-ca4e9550feb5 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] [instance: 5d5fdc92-2d08-4ae1-a508-032e39ce0958] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:57.847364 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-842c2a21-50b5-44c4-8151-ca4e9550feb5 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:57.848102 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-842c2a21-50b5-44c4-8151-ca4e9550feb5 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:57.848972 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-842c2a21-50b5-44c4-8151-ca4e9550feb5 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:57.849675 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-842c2a21-50b5-44c4-8151-ca4e9550feb5 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:58.260290 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-798d84f0-fd4f-4bba-be41-39769bcd4bba tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:58.269845 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-798d84f0-fd4f-4bba-be41-39769bcd4bba tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff" status: 200 len: 1523 microversion: 2.1 time: 0.708836 May 27 03:41:58.273620 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 85/162] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:57 2021] GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff => generated 1523 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:41:58.290282 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-78feb514-a0b5-450a-be16-ad641383b9ef tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:58.293773 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-78feb514-a0b5-450a-be16-ad641383b9ef tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 6a78b67b-ae82-47f7-9c4a-3698918592c6] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:58.302271 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-78feb514-a0b5-450a-be16-ad641383b9ef tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:58.303032 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-78feb514-a0b5-450a-be16-ad641383b9ef tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:58.304225 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-78feb514-a0b5-450a-be16-ad641383b9ef tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:58.304893 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-78feb514-a0b5-450a-be16-ad641383b9ef tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:58.530200 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-842c2a21-50b5-44c4-8151-ca4e9550feb5 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0207569193c64a2abbb1ae8f857d41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f220b161db454279a529469cc181cb86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:58.543152 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-842c2a21-50b5-44c4-8151-ca4e9550feb5 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] 10.222.0.25 "GET /compute/v2.1/servers/5d5fdc92-2d08-4ae1-a508-032e39ce0958" status: 200 len: 1554 microversion: 2.1 time: 0.705362 May 27 03:41:58.546210 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 78/163] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:57 2021] GET /compute/v2.1/servers/5d5fdc92-2d08-4ae1-a508-032e39ce0958 => generated 1554 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:41:58.832335 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-78feb514-a0b5-450a-be16-ad641383b9ef tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:41:58.848339 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-78feb514-a0b5-450a-be16-ad641383b9ef tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/6a78b67b-ae82-47f7-9c4a-3698918592c6" status: 200 len: 1318 microversion: 2.1 time: 0.567493 May 27 03:41:58.857373 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 86/164] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:58 2021] GET /compute/v2.1/servers/6a78b67b-ae82-47f7-9c4a-3698918592c6 => generated 1318 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:41:59.294797 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-621b4f6a-b293-40e7-a8da-c3333c8d5bf3 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:59.295494 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-621b4f6a-b293-40e7-a8da-c3333c8d5bf3 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: e3449057-b2c6-4b15-b705-4076eddfefff] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:59.304267 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-20f8cb37-0b67-487b-8c40-c56c6939bf46 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:41:59.312741 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-20f8cb37-0b67-487b-8c40-c56c6939bf46 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:59.335438 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-621b4f6a-b293-40e7-a8da-c3333c8d5bf3 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:59.336981 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-20f8cb37-0b67-487b-8c40-c56c6939bf46 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:59.337114 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-621b4f6a-b293-40e7-a8da-c3333c8d5bf3 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:59.338090 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-621b4f6a-b293-40e7-a8da-c3333c8d5bf3 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:59.338686 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-621b4f6a-b293-40e7-a8da-c3333c8d5bf3 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:59.346040 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-20f8cb37-0b67-487b-8c40-c56c6939bf46 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:59.347022 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-20f8cb37-0b67-487b-8c40-c56c6939bf46 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:59.347616 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-20f8cb37-0b67-487b-8c40-c56c6939bf46 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:59.576935 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-20f8cb37-0b67-487b-8c40-c56c6939bf46 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 14 microversion: 2.1 time: 0.278413 May 27 03:41:59.578084 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 87/165] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:41:59 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 14 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 03:41:59.583861 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [req-91e04a3e-c32b-477f-a244-fefec9ab7bc3 req-f0f9f4d3-0b8d-4905-a845-8d6800b01718 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c7e656a-afc5-4119-a11e-920c583d89d2", "tag": "24177437-ade1-43c7-bd7d-340757426924"}]} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:41:59.585412 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:41:59.585412 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: warnings.warn(msg) May 27 03:41:59.602167 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-91e04a3e-c32b-477f-a244-fefec9ab7bc3 req-f0f9f4d3-0b8d-4905-a845-8d6800b01718 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:59.603040 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-91e04a3e-c32b-477f-a244-fefec9ab7bc3 req-f0f9f4d3-0b8d-4905-a845-8d6800b01718 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:59.662737 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.compute.server_external_events [req-91e04a3e-c32b-477f-a244-fefec9ab7bc3 req-f0f9f4d3-0b8d-4905-a845-8d6800b01718 service nova] Creating event network-changed:24177437-ade1-43c7-bd7d-340757426924 for instance 3c7e656a-afc5-4119-a11e-920c583d89d2 on hv-cinder-79326 May 27 03:41:59.674009 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [req-91e04a3e-c32b-477f-a244-fefec9ab7bc3 req-f0f9f4d3-0b8d-4905-a845-8d6800b01718 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094065 May 27 03:41:59.674942 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 88/166] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:41:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:41:59.686456 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-c26ca8ba-8ae1-4025-9939-5624d9341e99 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:41:59.687206 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-c26ca8ba-8ae1-4025-9939-5624d9341e99 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] [instance: 5d5fdc92-2d08-4ae1-a508-032e39ce0958] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:41:59.708137 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c26ca8ba-8ae1-4025-9939-5624d9341e99 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:59.710433 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c26ca8ba-8ae1-4025-9939-5624d9341e99 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:41:59.710660 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c26ca8ba-8ae1-4025-9939-5624d9341e99 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:41:59.711118 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c26ca8ba-8ae1-4025-9939-5624d9341e99 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:00.128943 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-c26ca8ba-8ae1-4025-9939-5624d9341e99 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0207569193c64a2abbb1ae8f857d41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f220b161db454279a529469cc181cb86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:00.137677 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-c26ca8ba-8ae1-4025-9939-5624d9341e99 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] 10.222.0.25 "GET /compute/v2.1/servers/5d5fdc92-2d08-4ae1-a508-032e39ce0958" status: 200 len: 1554 microversion: 2.1 time: 0.461929 May 27 03:42:00.138256 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 89/167] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:59 2021] GET /compute/v2.1/servers/5d5fdc92-2d08-4ae1-a508-032e39ce0958 => generated 1554 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:00.142740 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-8f5677ff-a502-43cf-87b9-0e4cc70a103b tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:00.143347 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-8f5677ff-a502-43cf-87b9-0e4cc70a103b tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 6a78b67b-ae82-47f7-9c4a-3698918592c6] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:00.167145 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8f5677ff-a502-43cf-87b9-0e4cc70a103b tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:00.172694 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8f5677ff-a502-43cf-87b9-0e4cc70a103b tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:00.173738 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8f5677ff-a502-43cf-87b9-0e4cc70a103b tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:00.174339 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8f5677ff-a502-43cf-87b9-0e4cc70a103b tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:00.246017 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-621b4f6a-b293-40e7-a8da-c3333c8d5bf3 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:00.257450 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-621b4f6a-b293-40e7-a8da-c3333c8d5bf3 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff" status: 200 len: 1523 microversion: 2.1 time: 0.970640 May 27 03:42:00.258020 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 79/168] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:41:59 2021] GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff => generated 1523 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:00.549850 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-8f5677ff-a502-43cf-87b9-0e4cc70a103b tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:00.557114 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-8aa1d89d-7472-4386-9e11-c9bf3d3de2bd tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:00.558433 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-8aa1d89d-7472-4386-9e11-c9bf3d3de2bd tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:00.561401 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-8f5677ff-a502-43cf-87b9-0e4cc70a103b tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/6a78b67b-ae82-47f7-9c4a-3698918592c6" status: 200 len: 1318 microversion: 2.1 time: 0.422080 May 27 03:42:00.568735 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 90/169] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:42:00 2021] GET /compute/v2.1/servers/6a78b67b-ae82-47f7-9c4a-3698918592c6 => generated 1318 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:00.572181 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8aa1d89d-7472-4386-9e11-c9bf3d3de2bd tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:00.573792 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8aa1d89d-7472-4386-9e11-c9bf3d3de2bd tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:00.576131 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8aa1d89d-7472-4386-9e11-c9bf3d3de2bd tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:00.576826 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8aa1d89d-7472-4386-9e11-c9bf3d3de2bd tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:00.582411 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [req-15b85fb7-67ff-4628-897c-c7162bdc6387 req-c0c53e40-76db-49c8-bf47-f54efc7c8384 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e367eb4b-29c5-4f41-b41d-0da84d751fe2", "tag": "396ee32c-72a8-43ea-b35c-f0de6de19d7a"}]} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:00.584375 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:42:00.584375 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: warnings.warn(msg) May 27 03:42:00.603455 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-15b85fb7-67ff-4628-897c-c7162bdc6387 req-c0c53e40-76db-49c8-bf47-f54efc7c8384 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:00.603911 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-15b85fb7-67ff-4628-897c-c7162bdc6387 req-c0c53e40-76db-49c8-bf47-f54efc7c8384 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:00.643748 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.compute.server_external_events [req-15b85fb7-67ff-4628-897c-c7162bdc6387 req-c0c53e40-76db-49c8-bf47-f54efc7c8384 service nova] Creating event network-changed:396ee32c-72a8-43ea-b35c-f0de6de19d7a for instance e367eb4b-29c5-4f41-b41d-0da84d751fe2 on hv-cinder-79326 May 27 03:42:00.654008 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [req-15b85fb7-67ff-4628-897c-c7162bdc6387 req-c0c53e40-76db-49c8-bf47-f54efc7c8384 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076685 May 27 03:42:00.654785 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 91/170] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:42:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:42:00.660422 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-c1c8509b-f79b-4c8f-b742-2abff14b8e10 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:00.661450 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-c1c8509b-f79b-4c8f-b742-2abff14b8e10 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:00.686528 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c1c8509b-f79b-4c8f-b742-2abff14b8e10 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:00.686528 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c1c8509b-f79b-4c8f-b742-2abff14b8e10 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:00.688863 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c1c8509b-f79b-4c8f-b742-2abff14b8e10 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:00.688863 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c1c8509b-f79b-4c8f-b742-2abff14b8e10 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:00.762089 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-8aa1d89d-7472-4386-9e11-c9bf3d3de2bd tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 14 microversion: 2.20 time: 0.208557 May 27 03:42:00.766691 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 80/171] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:42:00 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 14 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:00.991781 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-c1c8509b-f79b-4c8f-b742-2abff14b8e10 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 14 microversion: 2.1 time: 0.335705 May 27 03:42:00.992767 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 92/172] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:42:00 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 14 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 03:42:01.155092 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-6973428c-de64-4f91-bed3-a75d1e2dcf48 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:01.155846 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-6973428c-de64-4f91-bed3-a75d1e2dcf48 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] [instance: 5d5fdc92-2d08-4ae1-a508-032e39ce0958] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:01.170837 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6973428c-de64-4f91-bed3-a75d1e2dcf48 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:01.182817 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6973428c-de64-4f91-bed3-a75d1e2dcf48 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:01.182817 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6973428c-de64-4f91-bed3-a75d1e2dcf48 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:01.192681 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6973428c-de64-4f91-bed3-a75d1e2dcf48 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:01.276211 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-ca67d5cc-98fd-4e75-8300-dcafc99289f5 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:01.277977 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-ca67d5cc-98fd-4e75-8300-dcafc99289f5 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: e3449057-b2c6-4b15-b705-4076eddfefff] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:01.293691 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ca67d5cc-98fd-4e75-8300-dcafc99289f5 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:01.297305 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ca67d5cc-98fd-4e75-8300-dcafc99289f5 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:01.297305 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ca67d5cc-98fd-4e75-8300-dcafc99289f5 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:01.299377 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ca67d5cc-98fd-4e75-8300-dcafc99289f5 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:01.534043 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-ca67d5cc-98fd-4e75-8300-dcafc99289f5 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:01.545900 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-ca67d5cc-98fd-4e75-8300-dcafc99289f5 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff" status: 200 len: 1523 microversion: 2.1 time: 0.272815 May 27 03:42:01.545900 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 93/173] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:42:01 2021] GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff => generated 1523 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:01.578933 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-a221e7ae-09d7-41c2-8b1c-03b0865c8fca tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:01.579681 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-a221e7ae-09d7-41c2-8b1c-03b0865c8fca tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 6a78b67b-ae82-47f7-9c4a-3698918592c6] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:01.589912 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a221e7ae-09d7-41c2-8b1c-03b0865c8fca tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:01.590409 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a221e7ae-09d7-41c2-8b1c-03b0865c8fca tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:01.591247 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a221e7ae-09d7-41c2-8b1c-03b0865c8fca tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:01.591944 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a221e7ae-09d7-41c2-8b1c-03b0865c8fca tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:01.862683 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-a221e7ae-09d7-41c2-8b1c-03b0865c8fca tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:01.871229 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-6973428c-de64-4f91-bed3-a75d1e2dcf48 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0207569193c64a2abbb1ae8f857d41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f220b161db454279a529469cc181cb86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:01.875063 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-a221e7ae-09d7-41c2-8b1c-03b0865c8fca tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/6a78b67b-ae82-47f7-9c4a-3698918592c6" status: 200 len: 1318 microversion: 2.1 time: 0.300640 May 27 03:42:01.885451 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 94/174] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:42:01 2021] GET /compute/v2.1/servers/6a78b67b-ae82-47f7-9c4a-3698918592c6 => generated 1318 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:42:01.885451 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-988cbb3d-0701-4624-8ccc-363fc9df07cb tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:01.885697 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-6973428c-de64-4f91-bed3-a75d1e2dcf48 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] 10.222.0.25 "GET /compute/v2.1/servers/5d5fdc92-2d08-4ae1-a508-032e39ce0958" status: 200 len: 1554 microversion: 2.1 time: 0.733625 May 27 03:42:01.885790 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-988cbb3d-0701-4624-8ccc-363fc9df07cb tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:01.885874 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 81/175] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:42:01 2021] GET /compute/v2.1/servers/5d5fdc92-2d08-4ae1-a508-032e39ce0958 => generated 1554 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:01.902778 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-988cbb3d-0701-4624-8ccc-363fc9df07cb tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:01.903332 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-988cbb3d-0701-4624-8ccc-363fc9df07cb tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:01.904109 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-988cbb3d-0701-4624-8ccc-363fc9df07cb tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:01.906381 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-988cbb3d-0701-4624-8ccc-363fc9df07cb tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:02.002556 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-6b249f03-c9ad-4ada-beb1-d4afdf4f1dfb tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:02.003481 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-6b249f03-c9ad-4ada-beb1-d4afdf4f1dfb tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:02.012638 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-988cbb3d-0701-4624-8ccc-363fc9df07cb tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 14 microversion: 2.20 time: 0.133380 May 27 03:42:02.014075 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 95/176] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:42:01 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 14 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:02.020966 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6b249f03-c9ad-4ada-beb1-d4afdf4f1dfb tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:02.026098 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6b249f03-c9ad-4ada-beb1-d4afdf4f1dfb tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:02.026098 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6b249f03-c9ad-4ada-beb1-d4afdf4f1dfb tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:02.026098 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6b249f03-c9ad-4ada-beb1-d4afdf4f1dfb tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:02.151313 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-6b249f03-c9ad-4ada-beb1-d4afdf4f1dfb tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 14 microversion: 2.1 time: 0.152128 May 27 03:42:02.152279 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 82/177] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:42:01 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 14 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 27 03:42:02.268923 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [req-f0f786fe-791f-4f58-97ff-2a7142cf9832 req-9486ae43-e30e-42f0-9d83-1461c8e8a9b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d5fdc92-2d08-4ae1-a508-032e39ce0958", "name": "network-vif-deleted", "tag": "1bbb12ef-9a7a-4069-a54e-b707ce9a6809"}]} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:02.270990 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:42:02.270990 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: warnings.warn(msg) May 27 03:42:02.281638 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-f0f786fe-791f-4f58-97ff-2a7142cf9832 req-9486ae43-e30e-42f0-9d83-1461c8e8a9b9 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:02.282256 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-f0f786fe-791f-4f58-97ff-2a7142cf9832 req-9486ae43-e30e-42f0-9d83-1461c8e8a9b9 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:02.317297 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.compute.server_external_events [req-f0f786fe-791f-4f58-97ff-2a7142cf9832 req-9486ae43-e30e-42f0-9d83-1461c8e8a9b9 service nova] Creating event network-vif-deleted:1bbb12ef-9a7a-4069-a54e-b707ce9a6809 for instance 5d5fdc92-2d08-4ae1-a508-032e39ce0958 on hv-cinder-79326 May 27 03:42:02.322324 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [req-f0f786fe-791f-4f58-97ff-2a7142cf9832 req-9486ae43-e30e-42f0-9d83-1461c8e8a9b9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058811 May 27 03:42:02.323437 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 96/178] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:42:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:42:02.566863 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-1b8bb770-6be4-4899-9dac-0bb4c522f18b tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:02.567947 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-1b8bb770-6be4-4899-9dac-0bb4c522f18b tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: e3449057-b2c6-4b15-b705-4076eddfefff] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:02.578700 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1b8bb770-6be4-4899-9dac-0bb4c522f18b tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:02.579373 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1b8bb770-6be4-4899-9dac-0bb4c522f18b tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:02.580363 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1b8bb770-6be4-4899-9dac-0bb4c522f18b tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:02.581066 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1b8bb770-6be4-4899-9dac-0bb4c522f18b tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:02.893140 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-91aa5f41-45a2-4843-913d-ee967fafebed tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:02.893875 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-91aa5f41-45a2-4843-913d-ee967fafebed tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 6a78b67b-ae82-47f7-9c4a-3698918592c6] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:02.901839 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-91aa5f41-45a2-4843-913d-ee967fafebed tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:02.902299 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-91aa5f41-45a2-4843-913d-ee967fafebed tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:02.903080 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-91aa5f41-45a2-4843-913d-ee967fafebed tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:02.903523 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-91aa5f41-45a2-4843-913d-ee967fafebed tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:02.937623 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-1b8bb770-6be4-4899-9dac-0bb4c522f18b tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:02.946216 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-1b8bb770-6be4-4899-9dac-0bb4c522f18b tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff" status: 200 len: 1523 microversion: 2.1 time: 0.386043 May 27 03:42:02.946875 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 83/179] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:42:02 2021] GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff => generated 1523 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:02.951548 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-192d9d20-8105-4ab0-82a2-645c1277fca9 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:02.952368 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-192d9d20-8105-4ab0-82a2-645c1277fca9 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] [instance: 5d5fdc92-2d08-4ae1-a508-032e39ce0958] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:02.960065 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-192d9d20-8105-4ab0-82a2-645c1277fca9 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:02.960625 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-192d9d20-8105-4ab0-82a2-645c1277fca9 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:02.961563 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-192d9d20-8105-4ab0-82a2-645c1277fca9 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:02.962068 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-192d9d20-8105-4ab0-82a2-645c1277fca9 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:03.131913 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-91aa5f41-45a2-4843-913d-ee967fafebed tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:03.140453 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-91aa5f41-45a2-4843-913d-ee967fafebed tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/6a78b67b-ae82-47f7-9c4a-3698918592c6" status: 200 len: 1318 microversion: 2.1 time: 0.251435 May 27 03:42:03.152257 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 97/180] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:42:02 2021] GET /compute/v2.1/servers/6a78b67b-ae82-47f7-9c4a-3698918592c6 => generated 1318 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:42:03.166196 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-acdd13c3-2187-4370-9093-3712f0832a40 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:03.168124 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-acdd13c3-2187-4370-9093-3712f0832a40 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:03.184434 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-acdd13c3-2187-4370-9093-3712f0832a40 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:03.184434 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-acdd13c3-2187-4370-9093-3712f0832a40 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:03.184434 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-acdd13c3-2187-4370-9093-3712f0832a40 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:03.184434 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-acdd13c3-2187-4370-9093-3712f0832a40 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:03.198022 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-192d9d20-8105-4ab0-82a2-645c1277fca9 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0207569193c64a2abbb1ae8f857d41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f220b161db454279a529469cc181cb86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:03.210541 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-192d9d20-8105-4ab0-82a2-645c1277fca9 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] 10.222.0.25 "GET /compute/v2.1/servers/5d5fdc92-2d08-4ae1-a508-032e39ce0958" status: 200 len: 1346 microversion: 2.1 time: 0.262435 May 27 03:42:03.211127 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 84/181] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:42:02 2021] GET /compute/v2.1/servers/5d5fdc92-2d08-4ae1-a508-032e39ce0958 => generated 1346 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:03.220857 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-cd08af88-1f4d-4bf2-9df2-43c835823c55 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:03.225433 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-cd08af88-1f4d-4bf2-9df2-43c835823c55 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:03.237979 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-cd08af88-1f4d-4bf2-9df2-43c835823c55 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:03.238677 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-cd08af88-1f4d-4bf2-9df2-43c835823c55 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:03.239666 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-cd08af88-1f4d-4bf2-9df2-43c835823c55 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:03.240453 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-cd08af88-1f4d-4bf2-9df2-43c835823c55 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:03.314952 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-acdd13c3-2187-4370-9093-3712f0832a40 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 14 microversion: 2.20 time: 0.161269 May 27 03:42:03.316438 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 98/182] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:42:03 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 14 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:03.963610 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-2d93a8a3-fe46-4f1f-8de5-32aa2f45feb9 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:03.964308 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-2d93a8a3-fe46-4f1f-8de5-32aa2f45feb9 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: e3449057-b2c6-4b15-b705-4076eddfefff] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:03.972203 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-2d93a8a3-fe46-4f1f-8de5-32aa2f45feb9 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:03.972694 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-2d93a8a3-fe46-4f1f-8de5-32aa2f45feb9 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:03.973462 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-2d93a8a3-fe46-4f1f-8de5-32aa2f45feb9 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:03.973905 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-2d93a8a3-fe46-4f1f-8de5-32aa2f45feb9 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:04.169870 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-2d93a8a3-fe46-4f1f-8de5-32aa2f45feb9 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:04.178028 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-2d93a8a3-fe46-4f1f-8de5-32aa2f45feb9 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff" status: 200 len: 1523 microversion: 2.1 time: 0.218541 May 27 03:42:04.178584 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 99/183] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:42:03 2021] GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff => generated 1523 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:42:04.182863 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-8b89e842-a10d-46a6-816c-ffc2ae9ba953 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:04.183460 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-8b89e842-a10d-46a6-816c-ffc2ae9ba953 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 6a78b67b-ae82-47f7-9c4a-3698918592c6] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:04.190554 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8b89e842-a10d-46a6-816c-ffc2ae9ba953 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:04.191016 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8b89e842-a10d-46a6-816c-ffc2ae9ba953 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:04.191778 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8b89e842-a10d-46a6-816c-ffc2ae9ba953 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:04.192210 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8b89e842-a10d-46a6-816c-ffc2ae9ba953 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:04.388177 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-8b89e842-a10d-46a6-816c-ffc2ae9ba953 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:04.396514 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-8b89e842-a10d-46a6-816c-ffc2ae9ba953 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/6a78b67b-ae82-47f7-9c4a-3698918592c6" status: 200 len: 1318 microversion: 2.1 time: 0.216874 May 27 03:42:04.397071 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 100/184] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:42:04 2021] GET /compute/v2.1/servers/6a78b67b-ae82-47f7-9c4a-3698918592c6 => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:04.401559 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-46ea9fef-1deb-4d5c-80b7-319a7a715782 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:04.402158 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-46ea9fef-1deb-4d5c-80b7-319a7a715782 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] [instance: 5d5fdc92-2d08-4ae1-a508-032e39ce0958] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:04.409313 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-46ea9fef-1deb-4d5c-80b7-319a7a715782 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:04.409763 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-46ea9fef-1deb-4d5c-80b7-319a7a715782 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:04.410558 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-46ea9fef-1deb-4d5c-80b7-319a7a715782 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:04.411207 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-46ea9fef-1deb-4d5c-80b7-319a7a715782 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:04.477184 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-46ea9fef-1deb-4d5c-80b7-319a7a715782 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:04.477639 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-46ea9fef-1deb-4d5c-80b7-319a7a715782 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:04.478107 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.objects.instance [None req-46ea9fef-1deb-4d5c-80b7-319a7a715782 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lazy-loading 'fault' on Instance uuid 5d5fdc92-2d08-4ae1-a508-032e39ce0958 {{(pid=113020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 27 03:42:04.534234 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-46ea9fef-1deb-4d5c-80b7-319a7a715782 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0207569193c64a2abbb1ae8f857d41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f220b161db454279a529469cc181cb86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:04.542929 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-46ea9fef-1deb-4d5c-80b7-319a7a715782 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] 10.222.0.25 "GET /compute/v2.1/servers/5d5fdc92-2d08-4ae1-a508-032e39ce0958" status: 200 len: 1351 microversion: 2.1 time: 0.144645 May 27 03:42:04.543489 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 101/185] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:42:04 2021] GET /compute/v2.1/servers/5d5fdc92-2d08-4ae1-a508-032e39ce0958 => generated 1351 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:04.548447 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-6a05e4fa-3e85-42cd-98a0-f96a5773e136 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:04.549358 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-6a05e4fa-3e85-42cd-98a0-f96a5773e136 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:04.556341 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6a05e4fa-3e85-42cd-98a0-f96a5773e136 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:04.556893 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6a05e4fa-3e85-42cd-98a0-f96a5773e136 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:04.557721 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6a05e4fa-3e85-42cd-98a0-f96a5773e136 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:04.558152 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6a05e4fa-3e85-42cd-98a0-f96a5773e136 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:04.897434 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-cd08af88-1f4d-4bf2-9df2-43c835823c55 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 14 microversion: 2.1 time: 1.681478 May 27 03:42:04.898286 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 85/186] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:42:03 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 14 bytes in 1683 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 03:42:05.195408 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-c329e9b1-314d-4c92-9fad-9fb3377e3cba tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:05.196118 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-c329e9b1-314d-4c92-9fad-9fb3377e3cba tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: e3449057-b2c6-4b15-b705-4076eddfefff] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:05.204574 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c329e9b1-314d-4c92-9fad-9fb3377e3cba tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:05.205040 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c329e9b1-314d-4c92-9fad-9fb3377e3cba tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:05.205812 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c329e9b1-314d-4c92-9fad-9fb3377e3cba tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:05.206258 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c329e9b1-314d-4c92-9fad-9fb3377e3cba tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:05.403783 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-c329e9b1-314d-4c92-9fad-9fb3377e3cba tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:05.412035 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-c329e9b1-314d-4c92-9fad-9fb3377e3cba tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff" status: 200 len: 1523 microversion: 2.1 time: 0.220803 May 27 03:42:05.412793 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 86/187] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:42:05 2021] GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff => generated 1523 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:42:05.416841 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-4682bc93-92a7-44c5-a17c-4b74483a2149 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:05.419607 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-4682bc93-92a7-44c5-a17c-4b74483a2149 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 6a78b67b-ae82-47f7-9c4a-3698918592c6] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:05.424696 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-4682bc93-92a7-44c5-a17c-4b74483a2149 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:05.425155 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-4682bc93-92a7-44c5-a17c-4b74483a2149 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:05.425935 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-4682bc93-92a7-44c5-a17c-4b74483a2149 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:05.426535 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-4682bc93-92a7-44c5-a17c-4b74483a2149 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:05.623131 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-4682bc93-92a7-44c5-a17c-4b74483a2149 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:05.632220 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-4682bc93-92a7-44c5-a17c-4b74483a2149 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/6a78b67b-ae82-47f7-9c4a-3698918592c6" status: 200 len: 1318 microversion: 2.1 time: 0.218583 May 27 03:42:05.632817 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 87/188] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:42:05 2021] GET /compute/v2.1/servers/6a78b67b-ae82-47f7-9c4a-3698918592c6 => generated 1318 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:05.637333 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-7b4bd067-d7a3-4adb-a7b7-cd28feb834a3 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:05.637949 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-7b4bd067-d7a3-4adb-a7b7-cd28feb834a3 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] [instance: 5d5fdc92-2d08-4ae1-a508-032e39ce0958] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:05.646175 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-7b4bd067-d7a3-4adb-a7b7-cd28feb834a3 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:05.646633 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-7b4bd067-d7a3-4adb-a7b7-cd28feb834a3 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:05.647435 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-7b4bd067-d7a3-4adb-a7b7-cd28feb834a3 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:05.647877 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-7b4bd067-d7a3-4adb-a7b7-cd28feb834a3 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:05.718373 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-7b4bd067-d7a3-4adb-a7b7-cd28feb834a3 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:05.718828 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-7b4bd067-d7a3-4adb-a7b7-cd28feb834a3 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:05.719526 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.objects.instance [None req-7b4bd067-d7a3-4adb-a7b7-cd28feb834a3 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lazy-loading 'fault' on Instance uuid 5d5fdc92-2d08-4ae1-a508-032e39ce0958 {{(pid=113021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 27 03:42:05.777499 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-7b4bd067-d7a3-4adb-a7b7-cd28feb834a3 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0207569193c64a2abbb1ae8f857d41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f220b161db454279a529469cc181cb86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:05.786946 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-7b4bd067-d7a3-4adb-a7b7-cd28feb834a3 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] 10.222.0.25 "GET /compute/v2.1/servers/5d5fdc92-2d08-4ae1-a508-032e39ce0958" status: 200 len: 1351 microversion: 2.1 time: 0.153141 May 27 03:42:05.787516 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 88/189] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:42:05 2021] GET /compute/v2.1/servers/5d5fdc92-2d08-4ae1-a508-032e39ce0958 => generated 1351 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:05.908057 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-705b2c70-3d24-4f8d-9259-375636e9c7c8 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:05.909039 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-705b2c70-3d24-4f8d-9259-375636e9c7c8 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:05.916268 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-705b2c70-3d24-4f8d-9259-375636e9c7c8 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:05.916744 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-705b2c70-3d24-4f8d-9259-375636e9c7c8 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:05.917763 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-705b2c70-3d24-4f8d-9259-375636e9c7c8 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:05.918196 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-705b2c70-3d24-4f8d-9259-375636e9c7c8 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:07.494609 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-6a05e4fa-3e85-42cd-98a0-f96a5773e136 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 14 microversion: 2.20 time: 2.949814 May 27 03:42:07.495247 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 102/190] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:42:04 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 14 bytes in 2951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:07.500787 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-ce44ccf8-bf86-45f3-a424-186db789f9bd tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:07.501678 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-ce44ccf8-bf86-45f3-a424-186db789f9bd tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: e3449057-b2c6-4b15-b705-4076eddfefff] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:07.509794 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ce44ccf8-bf86-45f3-a424-186db789f9bd tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:07.510243 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ce44ccf8-bf86-45f3-a424-186db789f9bd tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:07.511015 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ce44ccf8-bf86-45f3-a424-186db789f9bd tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:07.511455 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ce44ccf8-bf86-45f3-a424-186db789f9bd tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:07.539878 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-705b2c70-3d24-4f8d-9259-375636e9c7c8 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 14 microversion: 2.1 time: 1.635314 May 27 03:42:07.542864 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 89/191] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:42:05 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 14 bytes in 1637 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 27 03:42:07.547487 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-9b702982-8d41-41cd-8c31-3c721fd3b8fd tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:07.548194 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-9b702982-8d41-41cd-8c31-3c721fd3b8fd tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 6a78b67b-ae82-47f7-9c4a-3698918592c6] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:07.556023 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-9b702982-8d41-41cd-8c31-3c721fd3b8fd tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:07.556507 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-9b702982-8d41-41cd-8c31-3c721fd3b8fd tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:07.557291 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-9b702982-8d41-41cd-8c31-3c721fd3b8fd tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:07.557733 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-9b702982-8d41-41cd-8c31-3c721fd3b8fd tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:07.719300 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-ce44ccf8-bf86-45f3-a424-186db789f9bd tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:07.727614 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-ce44ccf8-bf86-45f3-a424-186db789f9bd tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff" status: 200 len: 1523 microversion: 2.1 time: 0.231164 May 27 03:42:07.728181 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 103/192] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:42:07 2021] GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff => generated 1523 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:07.732626 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-52e9ae32-5bf9-4c47-b99c-3b158fdfc8cf tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:07.733230 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-52e9ae32-5bf9-4c47-b99c-3b158fdfc8cf tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] [instance: 5d5fdc92-2d08-4ae1-a508-032e39ce0958] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:07.740695 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-52e9ae32-5bf9-4c47-b99c-3b158fdfc8cf tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:07.741155 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-52e9ae32-5bf9-4c47-b99c-3b158fdfc8cf tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:07.741919 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-52e9ae32-5bf9-4c47-b99c-3b158fdfc8cf tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:07.742354 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-52e9ae32-5bf9-4c47-b99c-3b158fdfc8cf tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:07.761782 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-9b702982-8d41-41cd-8c31-3c721fd3b8fd tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:07.770175 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-9b702982-8d41-41cd-8c31-3c721fd3b8fd tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/6a78b67b-ae82-47f7-9c4a-3698918592c6" status: 200 len: 1318 microversion: 2.1 time: 0.228204 May 27 03:42:07.770959 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 90/193] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:42:07 2021] GET /compute/v2.1/servers/6a78b67b-ae82-47f7-9c4a-3698918592c6 => generated 1318 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:07.809118 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-52e9ae32-5bf9-4c47-b99c-3b158fdfc8cf tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:07.809566 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-52e9ae32-5bf9-4c47-b99c-3b158fdfc8cf tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:07.810012 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.objects.instance [None req-52e9ae32-5bf9-4c47-b99c-3b158fdfc8cf tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lazy-loading 'fault' on Instance uuid 5d5fdc92-2d08-4ae1-a508-032e39ce0958 {{(pid=113020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 27 03:42:07.864720 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-52e9ae32-5bf9-4c47-b99c-3b158fdfc8cf tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0207569193c64a2abbb1ae8f857d41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f220b161db454279a529469cc181cb86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:07.873184 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-52e9ae32-5bf9-4c47-b99c-3b158fdfc8cf tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] 10.222.0.25 "GET /compute/v2.1/servers/5d5fdc92-2d08-4ae1-a508-032e39ce0958" status: 200 len: 1351 microversion: 2.1 time: 0.144029 May 27 03:42:07.873739 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 104/194] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:42:07 2021] GET /compute/v2.1/servers/5d5fdc92-2d08-4ae1-a508-032e39ce0958 => generated 1351 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:08.505909 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-0d28a35f-82a4-4609-aef5-f235ca2f37e6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:08.506835 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-0d28a35f-82a4-4609-aef5-f235ca2f37e6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:08.514157 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-0d28a35f-82a4-4609-aef5-f235ca2f37e6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:08.514630 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-0d28a35f-82a4-4609-aef5-f235ca2f37e6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:08.515968 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-0d28a35f-82a4-4609-aef5-f235ca2f37e6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:08.516428 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-0d28a35f-82a4-4609-aef5-f235ca2f37e6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:08.551133 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-95ad0111-09a7-47f9-a5c3-09cdf97fdef8 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:08.552259 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-95ad0111-09a7-47f9-a5c3-09cdf97fdef8 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:08.562099 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-95ad0111-09a7-47f9-a5c3-09cdf97fdef8 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:08.563783 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-95ad0111-09a7-47f9-a5c3-09cdf97fdef8 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:08.568171 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-95ad0111-09a7-47f9-a5c3-09cdf97fdef8 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:08.568860 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-95ad0111-09a7-47f9-a5c3-09cdf97fdef8 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:08.641421 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-0d28a35f-82a4-4609-aef5-f235ca2f37e6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 14 microversion: 2.20 time: 0.138891 May 27 03:42:08.642387 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 91/195] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:42:08 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 14 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:08.677384 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-95ad0111-09a7-47f9-a5c3-09cdf97fdef8 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 14 microversion: 2.1 time: 0.129644 May 27 03:42:08.680792 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 105/196] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:42:08 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 14 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 03:42:08.745213 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-7c01740d-d8fb-48b7-9dbb-efb72c9628af tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:08.747607 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-7c01740d-d8fb-48b7-9dbb-efb72c9628af tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: e3449057-b2c6-4b15-b705-4076eddfefff] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:08.754517 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-7c01740d-d8fb-48b7-9dbb-efb72c9628af tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:08.754970 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-7c01740d-d8fb-48b7-9dbb-efb72c9628af tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:08.755776 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-7c01740d-d8fb-48b7-9dbb-efb72c9628af tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:08.756229 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-7c01740d-d8fb-48b7-9dbb-efb72c9628af tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:08.787459 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-5fd65235-3eea-4b19-82a6-7f4ea876a122 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:08.788354 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-5fd65235-3eea-4b19-82a6-7f4ea876a122 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 6a78b67b-ae82-47f7-9c4a-3698918592c6] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:08.797203 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-5fd65235-3eea-4b19-82a6-7f4ea876a122 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:08.797842 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-5fd65235-3eea-4b19-82a6-7f4ea876a122 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:08.798721 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-5fd65235-3eea-4b19-82a6-7f4ea876a122 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:08.799283 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-5fd65235-3eea-4b19-82a6-7f4ea876a122 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:08.993822 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-7c01740d-d8fb-48b7-9dbb-efb72c9628af tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:09.002572 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-7c01740d-d8fb-48b7-9dbb-efb72c9628af tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff" status: 200 len: 1523 microversion: 2.1 time: 0.261293 May 27 03:42:09.003887 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 92/197] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:42:08 2021] GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff => generated 1523 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:09.008679 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-3b18f816-81f2-4385-b3ae-a945ee373c98 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:09.011900 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-3b18f816-81f2-4385-b3ae-a945ee373c98 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] [instance: 5d5fdc92-2d08-4ae1-a508-032e39ce0958] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:09.018525 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-3b18f816-81f2-4385-b3ae-a945ee373c98 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:09.019277 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-3b18f816-81f2-4385-b3ae-a945ee373c98 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:09.020133 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-3b18f816-81f2-4385-b3ae-a945ee373c98 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:09.020893 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-3b18f816-81f2-4385-b3ae-a945ee373c98 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:09.046651 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-5fd65235-3eea-4b19-82a6-7f4ea876a122 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:09.056212 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-5fd65235-3eea-4b19-82a6-7f4ea876a122 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/6a78b67b-ae82-47f7-9c4a-3698918592c6" status: 200 len: 1318 microversion: 2.1 time: 0.272975 May 27 03:42:09.057248 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 106/198] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:42:08 2021] GET /compute/v2.1/servers/6a78b67b-ae82-47f7-9c4a-3698918592c6 => generated 1318 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:09.074996 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.wsgi [None req-3b18f816-81f2-4385-b3ae-a945ee373c98 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] HTTP exception thrown: Instance 5d5fdc92-2d08-4ae1-a508-032e39ce0958 could not be found. May 27 03:42:09.075796 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-3b18f816-81f2-4385-b3ae-a945ee373c98 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Returning 404 to user: Instance 5d5fdc92-2d08-4ae1-a508-032e39ce0958 could not be found. {{(pid=113021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 27 03:42:09.076919 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-3b18f816-81f2-4385-b3ae-a945ee373c98 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] 10.222.0.25 "GET /compute/v2.1/servers/5d5fdc92-2d08-4ae1-a508-032e39ce0958" status: 404 len: 111 microversion: 2.1 time: 0.071693 May 27 03:42:09.078478 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 93/199] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:42:09 2021] GET /compute/v2.1/servers/5d5fdc92-2d08-4ae1-a508-032e39ce0958 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:42:09.653142 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-0704350c-ea75-4eb2-b31c-450a6647df97 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:09.654184 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-0704350c-ea75-4eb2-b31c-450a6647df97 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:09.663472 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0704350c-ea75-4eb2-b31c-450a6647df97 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:09.664203 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0704350c-ea75-4eb2-b31c-450a6647df97 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:09.670804 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0704350c-ea75-4eb2-b31c-450a6647df97 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:09.670804 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0704350c-ea75-4eb2-b31c-450a6647df97 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:09.688939 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-ffaeb966-60d8-4a60-a05c-19ad41591c75 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:09.690510 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-ffaeb966-60d8-4a60-a05c-19ad41591c75 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:09.708502 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ffaeb966-60d8-4a60-a05c-19ad41591c75 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:09.708958 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ffaeb966-60d8-4a60-a05c-19ad41591c75 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:09.709788 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ffaeb966-60d8-4a60-a05c-19ad41591c75 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:09.710269 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ffaeb966-60d8-4a60-a05c-19ad41591c75 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:09.876483 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-0704350c-ea75-4eb2-b31c-450a6647df97 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 14 microversion: 2.20 time: 0.227441 May 27 03:42:09.877122 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 107/200] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:42:09 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 14 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:09.883262 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-ffaeb966-60d8-4a60-a05c-19ad41591c75 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 14 microversion: 2.1 time: 0.198330 May 27 03:42:09.883962 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 94/201] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:42:09 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 14 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 27 03:42:10.020458 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-3fdcef88-40c3-43fb-ba8d-c5711663deb2 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:10.021256 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-3fdcef88-40c3-43fb-ba8d-c5711663deb2 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: e3449057-b2c6-4b15-b705-4076eddfefff] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:10.029795 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3fdcef88-40c3-43fb-ba8d-c5711663deb2 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:10.030244 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3fdcef88-40c3-43fb-ba8d-c5711663deb2 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:10.031582 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3fdcef88-40c3-43fb-ba8d-c5711663deb2 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:10.032119 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3fdcef88-40c3-43fb-ba8d-c5711663deb2 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:10.073879 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-8a7bf65f-45c7-41ab-b4e9-979336e5db4e tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:10.074839 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-8a7bf65f-45c7-41ab-b4e9-979336e5db4e tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 6a78b67b-ae82-47f7-9c4a-3698918592c6] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:10.082989 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8a7bf65f-45c7-41ab-b4e9-979336e5db4e tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:10.083556 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8a7bf65f-45c7-41ab-b4e9-979336e5db4e tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:10.084499 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8a7bf65f-45c7-41ab-b4e9-979336e5db4e tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:10.085038 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8a7bf65f-45c7-41ab-b4e9-979336e5db4e tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:10.247740 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-3fdcef88-40c3-43fb-ba8d-c5711663deb2 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:10.255902 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-3fdcef88-40c3-43fb-ba8d-c5711663deb2 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff" status: 200 len: 1523 microversion: 2.1 time: 0.239797 May 27 03:42:10.256810 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 108/202] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:42:10 2021] GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff => generated 1523 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:10.328089 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-8a7bf65f-45c7-41ab-b4e9-979336e5db4e tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:10.336499 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-8a7bf65f-45c7-41ab-b4e9-979336e5db4e tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/6a78b67b-ae82-47f7-9c4a-3698918592c6" status: 200 len: 1318 microversion: 2.1 time: 0.266613 May 27 03:42:10.337693 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 95/203] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:42:10 2021] GET /compute/v2.1/servers/6a78b67b-ae82-47f7-9c4a-3698918592c6 => generated 1318 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:42:10.838703 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-871fd81d-ff94-466d-b91a-476639a9e81a tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:10.839073 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-871fd81d-ff94-466d-b91a-476639a9e81a tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] [instance: 5d5fdc92-2d08-4ae1-a508-032e39ce0958] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:10.846442 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-871fd81d-ff94-466d-b91a-476639a9e81a tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:10.846922 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-871fd81d-ff94-466d-b91a-476639a9e81a tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:10.847690 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-871fd81d-ff94-466d-b91a-476639a9e81a tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:10.848123 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-871fd81d-ff94-466d-b91a-476639a9e81a tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:10.887236 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-50ca4786-ed46-4f87-a4f3-d9c8e1fce52d tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:10.888772 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-50ca4786-ed46-4f87-a4f3-d9c8e1fce52d tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:10.897226 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-50ca4786-ed46-4f87-a4f3-d9c8e1fce52d tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:10.900548 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-50ca4786-ed46-4f87-a4f3-d9c8e1fce52d tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:10.900679 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.wsgi [None req-871fd81d-ff94-466d-b91a-476639a9e81a tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] HTTP exception thrown: Instance 5d5fdc92-2d08-4ae1-a508-032e39ce0958 could not be found. May 27 03:42:10.900970 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-50ca4786-ed46-4f87-a4f3-d9c8e1fce52d tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:10.901068 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-871fd81d-ff94-466d-b91a-476639a9e81a tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Returning 404 to user: Instance 5d5fdc92-2d08-4ae1-a508-032e39ce0958 could not be found. {{(pid=113020) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 27 03:42:10.901187 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-50ca4786-ed46-4f87-a4f3-d9c8e1fce52d tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:10.901273 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-871fd81d-ff94-466d-b91a-476639a9e81a tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5d5fdc92-2d08-4ae1-a508-032e39ce0958" status: 404 len: 111 microversion: 2.1 time: 0.065243 May 27 03:42:10.901273 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 109/204] 10.222.0.25 () {58 vars in 1239 bytes} [Thu May 27 03:42:10 2021] DELETE /compute/v2.1/servers/5d5fdc92-2d08-4ae1-a508-032e39ce0958 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:42:10.904863 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-8c60214a-758f-466d-b023-dcecc422a2ff tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:10.905910 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-8c60214a-758f-466d-b023-dcecc422a2ff tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:10.913765 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8c60214a-758f-466d-b023-dcecc422a2ff tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:10.914209 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8c60214a-758f-466d-b023-dcecc422a2ff tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:10.914973 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8c60214a-758f-466d-b023-dcecc422a2ff tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:10.915405 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8c60214a-758f-466d-b023-dcecc422a2ff tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:11.113003 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-50ca4786-ed46-4f87-a4f3-d9c8e1fce52d tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 14 microversion: 2.20 time: 0.123177 May 27 03:42:11.113003 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 96/205] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:42:10 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 14 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:42:11.113003 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-b8ed2c21-c0a5-482c-a56c-64b1ecfb4108 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:11.113003 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-b8ed2c21-c0a5-482c-a56c-64b1ecfb4108 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] [instance: 5d5fdc92-2d08-4ae1-a508-032e39ce0958] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:11.114755 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-8c60214a-758f-466d-b023-dcecc422a2ff tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 8637 microversion: 2.1 time: 0.115735 May 27 03:42:11.114755 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 110/206] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:42:10 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 8637 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:11.114904 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b8ed2c21-c0a5-482c-a56c-64b1ecfb4108 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:11.114904 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b8ed2c21-c0a5-482c-a56c-64b1ecfb4108 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:11.114904 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b8ed2c21-c0a5-482c-a56c-64b1ecfb4108 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:11.114904 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b8ed2c21-c0a5-482c-a56c-64b1ecfb4108 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:11.115160 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.wsgi [None req-b8ed2c21-c0a5-482c-a56c-64b1ecfb4108 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] HTTP exception thrown: Instance 5d5fdc92-2d08-4ae1-a508-032e39ce0958 could not be found. May 27 03:42:11.115160 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-b8ed2c21-c0a5-482c-a56c-64b1ecfb4108 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] Returning 404 to user: Instance 5d5fdc92-2d08-4ae1-a508-032e39ce0958 could not be found. {{(pid=113021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 27 03:42:11.115160 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-b8ed2c21-c0a5-482c-a56c-64b1ecfb4108 tempest-DeleteServersTestJSON-1681401445 tempest-DeleteServersTestJSON-1681401445-project] 10.222.0.25 "GET /compute/v2.1/servers/5d5fdc92-2d08-4ae1-a508-032e39ce0958" status: 404 len: 111 microversion: 2.1 time: 0.063424 May 27 03:42:11.115160 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 97/207] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:42:11 2021] GET /compute/v2.1/servers/5d5fdc92-2d08-4ae1-a508-032e39ce0958 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:42:11.274709 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-fe6083a5-9541-4f16-8314-3576d74fb7ca tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:11.275423 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-fe6083a5-9541-4f16-8314-3576d74fb7ca tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: e3449057-b2c6-4b15-b705-4076eddfefff] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:11.283966 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-fe6083a5-9541-4f16-8314-3576d74fb7ca tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:11.284438 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-fe6083a5-9541-4f16-8314-3576d74fb7ca tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:11.285228 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-fe6083a5-9541-4f16-8314-3576d74fb7ca tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:11.285668 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-fe6083a5-9541-4f16-8314-3576d74fb7ca tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:11.354254 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-134966c9-146d-4b87-8bdc-f40502fbce77 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:11.358082 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-134966c9-146d-4b87-8bdc-f40502fbce77 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 6a78b67b-ae82-47f7-9c4a-3698918592c6] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:11.363414 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-134966c9-146d-4b87-8bdc-f40502fbce77 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:11.364444 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-134966c9-146d-4b87-8bdc-f40502fbce77 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:11.365506 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-134966c9-146d-4b87-8bdc-f40502fbce77 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:11.366193 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-134966c9-146d-4b87-8bdc-f40502fbce77 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:11.675501 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-fe6083a5-9541-4f16-8314-3576d74fb7ca tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:11.681208 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-134966c9-146d-4b87-8bdc-f40502fbce77 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:11.687022 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-fe6083a5-9541-4f16-8314-3576d74fb7ca tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff" status: 200 len: 1523 microversion: 2.1 time: 0.416749 May 27 03:42:11.694032 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 111/208] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:42:11 2021] GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff => generated 1523 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:11.701776 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-134966c9-146d-4b87-8bdc-f40502fbce77 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/6a78b67b-ae82-47f7-9c4a-3698918592c6" status: 200 len: 1318 microversion: 2.1 time: 0.351228 May 27 03:42:11.714842 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 98/209] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:42:11 2021] GET /compute/v2.1/servers/6a78b67b-ae82-47f7-9c4a-3698918592c6 => generated 1318 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:42:11.853203 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [req-e5f0ab7a-b10a-4049-9775-10cf4c626c93 req-763e4680-281f-416a-a6d7-db09f5affb31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a78b67b-ae82-47f7-9c4a-3698918592c6", "name": "network-vif-plugged", "status": "completed", "tag": "7c9d543c-8635-48f1-aa64-5b32d4b0b972"}]} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:11.856471 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:42:11.856471 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: warnings.warn(msg) May 27 03:42:11.866296 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-e5f0ab7a-b10a-4049-9775-10cf4c626c93 req-763e4680-281f-416a-a6d7-db09f5affb31 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:11.866296 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-e5f0ab7a-b10a-4049-9775-10cf4c626c93 req-763e4680-281f-416a-a6d7-db09f5affb31 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:11.881229 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.compute.server_external_events [req-e5f0ab7a-b10a-4049-9775-10cf4c626c93 req-763e4680-281f-416a-a6d7-db09f5affb31 service nova] Creating event network-vif-plugged:7c9d543c-8635-48f1-aa64-5b32d4b0b972 for instance 6a78b67b-ae82-47f7-9c4a-3698918592c6 on hv-cinder-79326 May 27 03:42:11.886124 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [req-e5f0ab7a-b10a-4049-9775-10cf4c626c93 req-763e4680-281f-416a-a6d7-db09f5affb31 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036603 May 27 03:42:11.887072 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 112/210] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:42:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:42:12.086285 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-8200c48f-e8c1-4f28-8c79-5dc06312fd66 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:12.086285 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-8200c48f-e8c1-4f28-8c79-5dc06312fd66 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:12.097183 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-c9a94602-69a3-4caa-8033-d0594be1c9e7 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:12.098548 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-c9a94602-69a3-4caa-8033-d0594be1c9e7 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:12.107551 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c9a94602-69a3-4caa-8033-d0594be1c9e7 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:12.108019 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c9a94602-69a3-4caa-8033-d0594be1c9e7 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:12.109003 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c9a94602-69a3-4caa-8033-d0594be1c9e7 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:12.113194 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c9a94602-69a3-4caa-8033-d0594be1c9e7 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:12.113319 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8200c48f-e8c1-4f28-8c79-5dc06312fd66 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:12.113319 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8200c48f-e8c1-4f28-8c79-5dc06312fd66 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:12.113319 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8200c48f-e8c1-4f28-8c79-5dc06312fd66 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:12.113319 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8200c48f-e8c1-4f28-8c79-5dc06312fd66 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:12.253810 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-8200c48f-e8c1-4f28-8c79-5dc06312fd66 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 6451 microversion: 2.20 time: 0.172381 May 27 03:42:12.257612 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 99/211] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:42:12 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 6451 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:42:12.275362 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-c9a94602-69a3-4caa-8033-d0594be1c9e7 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 15169 microversion: 2.1 time: 0.184736 May 27 03:42:12.276227 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 113/212] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:42:12 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 15169 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:42:12.704798 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-be91dcd1-4d7e-486c-86df-121c0049da6c tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:12.705717 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-be91dcd1-4d7e-486c-86df-121c0049da6c tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: e3449057-b2c6-4b15-b705-4076eddfefff] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:12.713754 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-be91dcd1-4d7e-486c-86df-121c0049da6c tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:12.714463 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-be91dcd1-4d7e-486c-86df-121c0049da6c tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:12.715486 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-be91dcd1-4d7e-486c-86df-121c0049da6c tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:12.716264 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-be91dcd1-4d7e-486c-86df-121c0049da6c tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:12.728123 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-56abc42a-2288-42f1-a8b5-49dc5add58f7 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:12.728123 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-56abc42a-2288-42f1-a8b5-49dc5add58f7 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 6a78b67b-ae82-47f7-9c4a-3698918592c6] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:12.742780 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-56abc42a-2288-42f1-a8b5-49dc5add58f7 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:12.743398 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-56abc42a-2288-42f1-a8b5-49dc5add58f7 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:12.744725 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-56abc42a-2288-42f1-a8b5-49dc5add58f7 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:12.745550 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-56abc42a-2288-42f1-a8b5-49dc5add58f7 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:13.131008 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-56abc42a-2288-42f1-a8b5-49dc5add58f7 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:13.140839 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-56abc42a-2288-42f1-a8b5-49dc5add58f7 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/6a78b67b-ae82-47f7-9c4a-3698918592c6" status: 200 len: 1318 microversion: 2.1 time: 0.422104 May 27 03:42:13.141710 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 114/213] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:42:12 2021] GET /compute/v2.1/servers/6a78b67b-ae82-47f7-9c4a-3698918592c6 => generated 1318 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:13.265779 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-6aaa6370-0ac4-4741-9648-f1fb34a24857 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:13.266709 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-6aaa6370-0ac4-4741-9648-f1fb34a24857 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:13.287308 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6aaa6370-0ac4-4741-9648-f1fb34a24857 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:13.287766 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6aaa6370-0ac4-4741-9648-f1fb34a24857 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:13.288568 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6aaa6370-0ac4-4741-9648-f1fb34a24857 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:13.289093 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6aaa6370-0ac4-4741-9648-f1fb34a24857 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:13.422214 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-6aaa6370-0ac4-4741-9648-f1fb34a24857 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 13447 microversion: 2.20 time: 0.159342 May 27 03:42:13.422890 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 115/214] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:42:13 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 13447 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:42:13.428627 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-ed409eee-3ce5-4225-b9bb-05df4ad9af6b tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:13.429792 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-ed409eee-3ce5-4225-b9bb-05df4ad9af6b tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:13.438625 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ed409eee-3ce5-4225-b9bb-05df4ad9af6b tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:13.439022 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ed409eee-3ce5-4225-b9bb-05df4ad9af6b tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:13.439790 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ed409eee-3ce5-4225-b9bb-05df4ad9af6b tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:13.440463 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ed409eee-3ce5-4225-b9bb-05df4ad9af6b tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:13.476822 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-be91dcd1-4d7e-486c-86df-121c0049da6c tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:13.486103 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-be91dcd1-4d7e-486c-86df-121c0049da6c tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff" status: 200 len: 1523 microversion: 2.1 time: 0.785499 May 27 03:42:13.496110 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 100/215] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:42:12 2021] GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff => generated 1523 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:13.579202 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-ed409eee-3ce5-4225-b9bb-05df4ad9af6b tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 18056 microversion: 2.1 time: 0.154279 May 27 03:42:13.579867 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 116/216] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:42:13 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 18056 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:42:14.158555 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-8deca261-1189-4144-a610-392c92e7bd40 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:14.159209 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-8deca261-1189-4144-a610-392c92e7bd40 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 6a78b67b-ae82-47f7-9c4a-3698918592c6] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:14.166950 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8deca261-1189-4144-a610-392c92e7bd40 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:14.168163 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8deca261-1189-4144-a610-392c92e7bd40 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:14.169207 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8deca261-1189-4144-a610-392c92e7bd40 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:14.169797 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8deca261-1189-4144-a610-392c92e7bd40 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:14.434313 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-3db921cb-1fa3-434b-a3ad-ee7a5e3ae05c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:14.435559 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-3db921cb-1fa3-434b-a3ad-ee7a5e3ae05c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:14.447836 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3db921cb-1fa3-434b-a3ad-ee7a5e3ae05c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:14.450599 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3db921cb-1fa3-434b-a3ad-ee7a5e3ae05c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:14.456103 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3db921cb-1fa3-434b-a3ad-ee7a5e3ae05c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:14.456770 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3db921cb-1fa3-434b-a3ad-ee7a5e3ae05c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:14.633835 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-3db921cb-1fa3-434b-a3ad-ee7a5e3ae05c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 17171 microversion: 2.20 time: 0.203725 May 27 03:42:14.635666 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 117/217] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:42:14 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 17171 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 27 03:42:14.643742 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-afd2d152-94b9-40f8-b56c-e8f7cfbab231 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:14.644950 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-afd2d152-94b9-40f8-b56c-e8f7cfbab231 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: e3449057-b2c6-4b15-b705-4076eddfefff] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:14.656674 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-afd2d152-94b9-40f8-b56c-e8f7cfbab231 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:14.657557 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-afd2d152-94b9-40f8-b56c-e8f7cfbab231 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:14.658839 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-afd2d152-94b9-40f8-b56c-e8f7cfbab231 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:14.659480 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-afd2d152-94b9-40f8-b56c-e8f7cfbab231 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:14.720868 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-8deca261-1189-4144-a610-392c92e7bd40 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:14.736330 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-8deca261-1189-4144-a610-392c92e7bd40 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/6a78b67b-ae82-47f7-9c4a-3698918592c6" status: 200 len: 1318 microversion: 2.1 time: 0.577394 May 27 03:42:14.736330 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 101/218] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:42:14 2021] GET /compute/v2.1/servers/6a78b67b-ae82-47f7-9c4a-3698918592c6 => generated 1318 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:42:14.742073 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-54f54255-cbe2-4db7-b3b6-e20bb58bf1dc tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:14.743358 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-54f54255-cbe2-4db7-b3b6-e20bb58bf1dc tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:14.751575 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-54f54255-cbe2-4db7-b3b6-e20bb58bf1dc tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:14.752190 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-54f54255-cbe2-4db7-b3b6-e20bb58bf1dc tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:14.753087 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-54f54255-cbe2-4db7-b3b6-e20bb58bf1dc tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:14.753608 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-54f54255-cbe2-4db7-b3b6-e20bb58bf1dc tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:14.911777 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-54f54255-cbe2-4db7-b3b6-e20bb58bf1dc tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 19774 microversion: 2.1 time: 0.173441 May 27 03:42:14.912590 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 102/219] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:42:14 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 19774 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:42:14.989028 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-afd2d152-94b9-40f8-b56c-e8f7cfbab231 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:14.997542 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-afd2d152-94b9-40f8-b56c-e8f7cfbab231 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff" status: 200 len: 1523 microversion: 2.1 time: 0.360899 May 27 03:42:14.998160 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 118/220] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:42:14 2021] GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff => generated 1523 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:15.647406 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-7f47d713-6bf0-4210-9052-12c69da14061 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:15.648508 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-7f47d713-6bf0-4210-9052-12c69da14061 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:15.657811 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-7f47d713-6bf0-4210-9052-12c69da14061 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:15.658559 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-7f47d713-6bf0-4210-9052-12c69da14061 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:15.659565 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-7f47d713-6bf0-4210-9052-12c69da14061 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:15.660080 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-7f47d713-6bf0-4210-9052-12c69da14061 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:15.756903 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-be7e2936-b891-49ea-b13d-1c77ff679043 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:15.757531 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-be7e2936-b891-49ea-b13d-1c77ff679043 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 6a78b67b-ae82-47f7-9c4a-3698918592c6] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:15.766141 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-be7e2936-b891-49ea-b13d-1c77ff679043 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:15.767136 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-be7e2936-b891-49ea-b13d-1c77ff679043 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:15.768031 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-7f47d713-6bf0-4210-9052-12c69da14061 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 18013 microversion: 2.20 time: 0.124297 May 27 03:42:15.768736 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-be7e2936-b891-49ea-b13d-1c77ff679043 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:15.769395 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-be7e2936-b891-49ea-b13d-1c77ff679043 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:15.769576 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 103/221] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:42:15 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 18013 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:42:15.926118 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-fe069ed4-9913-486a-93b1-fa3f821afc84 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:15.927351 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-fe069ed4-9913-486a-93b1-fa3f821afc84 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:15.938060 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-fe069ed4-9913-486a-93b1-fa3f821afc84 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:15.938801 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-fe069ed4-9913-486a-93b1-fa3f821afc84 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:15.939749 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-fe069ed4-9913-486a-93b1-fa3f821afc84 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:15.940340 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-fe069ed4-9913-486a-93b1-fa3f821afc84 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:16.067808 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-fe069ed4-9913-486a-93b1-fa3f821afc84 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 22079 microversion: 2.1 time: 0.147175 May 27 03:42:16.067987 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-be7e2936-b891-49ea-b13d-1c77ff679043 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:16.069114 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 104/222] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:42:15 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 22079 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:42:16.074950 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-dea12182-f350-4bb2-aa8f-aebe6c381479 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:16.075821 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-dea12182-f350-4bb2-aa8f-aebe6c381479 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: e3449057-b2c6-4b15-b705-4076eddfefff] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:16.082204 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-be7e2936-b891-49ea-b13d-1c77ff679043 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/6a78b67b-ae82-47f7-9c4a-3698918592c6" status: 200 len: 1509 microversion: 2.1 time: 0.325785 May 27 03:42:16.082204 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 119/223] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:42:15 2021] GET /compute/v2.1/servers/6a78b67b-ae82-47f7-9c4a-3698918592c6 => generated 1509 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:16.089276 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-dea12182-f350-4bb2-aa8f-aebe6c381479 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:16.089811 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-dea12182-f350-4bb2-aa8f-aebe6c381479 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:16.090885 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-dea12182-f350-4bb2-aa8f-aebe6c381479 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:16.091403 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-dea12182-f350-4bb2-aa8f-aebe6c381479 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:16.095710 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-b63c8222-2e24-4e82-87bb-19c440ce6592 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "49adedce-6897-4136-8d88-700512754351"}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:16.097502 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-b63c8222-2e24-4e82-87bb-19c440ce6592 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 6a78b67b-ae82-47f7-9c4a-3698918592c6] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:16.106918 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b63c8222-2e24-4e82-87bb-19c440ce6592 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:16.107381 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b63c8222-2e24-4e82-87bb-19c440ce6592 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:16.108163 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b63c8222-2e24-4e82-87bb-19c440ce6592 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:16.108955 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b63c8222-2e24-4e82-87bb-19c440ce6592 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:16.304440 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.wsgi [None req-b63c8222-2e24-4e82-87bb-19c440ce6592 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] HTTP exception thrown: Invalid volume: volume 49adedce-6897-4136-8d88-700512754351 is already attached to instances: 695616b8-9b90-4e8d-b719-de3eabe09cbe May 27 03:42:16.310765 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-b63c8222-2e24-4e82-87bb-19c440ce6592 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Returning 400 to user: Invalid volume: volume 49adedce-6897-4136-8d88-700512754351 is already attached to instances: 695616b8-9b90-4e8d-b719-de3eabe09cbe {{(pid=113020) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 27 03:42:16.310765 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-b63c8222-2e24-4e82-87bb-19c440ce6592 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "POST /compute/v2.1/servers/6a78b67b-ae82-47f7-9c4a-3698918592c6/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.214886 May 27 03:42:16.310765 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 120/224] 10.222.0.25 () {60 vars in 1323 bytes} [Thu May 27 03:42:16 2021] POST /compute/v2.1/servers/6a78b67b-ae82-47f7-9c4a-3698918592c6/os-volume_attachments => generated 174 bytes in 216 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 27 03:42:16.329197 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-dea12182-f350-4bb2-aa8f-aebe6c381479 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:16.339244 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-dea12182-f350-4bb2-aa8f-aebe6c381479 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff" status: 200 len: 1523 microversion: 2.1 time: 0.267763 May 27 03:42:16.348976 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 105/225] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:42:16 2021] GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff => generated 1523 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:16.446880 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-83dc137a-6dca-4ed4-9a67-fe8fffddb4e5 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:16.447508 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-83dc137a-6dca-4ed4-9a67-fe8fffddb4e5 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 695616b8-9b90-4e8d-b719-de3eabe09cbe] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:16.459046 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-83dc137a-6dca-4ed4-9a67-fe8fffddb4e5 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:16.459547 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-83dc137a-6dca-4ed4-9a67-fe8fffddb4e5 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:16.460322 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-83dc137a-6dca-4ed4-9a67-fe8fffddb4e5 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:16.461142 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-83dc137a-6dca-4ed4-9a67-fe8fffddb4e5 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:16.628673 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.objects.instance [None req-83dc137a-6dca-4ed4-9a67-fe8fffddb4e5 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lazy-loading 'services' on Instance uuid 695616b8-9b90-4e8d-b719-de3eabe09cbe {{(pid=113020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 27 03:42:16.779666 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-279ade3d-30c0-438a-be8d-c79d3f8aa557 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:16.781408 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-279ade3d-30c0-438a-be8d-c79d3f8aa557 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:16.789506 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-279ade3d-30c0-438a-be8d-c79d3f8aa557 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:16.790280 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-279ade3d-30c0-438a-be8d-c79d3f8aa557 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:16.791492 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-279ade3d-30c0-438a-be8d-c79d3f8aa557 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:16.792357 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-279ade3d-30c0-438a-be8d-c79d3f8aa557 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:16.902936 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-83dc137a-6dca-4ed4-9a67-fe8fffddb4e5 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "DELETE /compute/v2.1/servers/695616b8-9b90-4e8d-b719-de3eabe09cbe/os-volume_attachments/49adedce-6897-4136-8d88-700512754351" status: 202 len: 0 microversion: 2.1 time: 0.459791 May 27 03:42:16.904589 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 121/226] 10.222.0.25 () {58 vars in 1416 bytes} [Thu May 27 03:42:16 2021] DELETE /compute/v2.1/servers/695616b8-9b90-4e8d-b719-de3eabe09cbe/os-volume_attachments/49adedce-6897-4136-8d88-700512754351 => generated 0 bytes in 462 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:42:16.905046 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-279ade3d-30c0-438a-be8d-c79d3f8aa557 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 20173 microversion: 2.20 time: 0.129074 May 27 03:42:16.906412 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 106/227] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:42:16 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 20173 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 27 03:42:17.081069 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-0faf10fa-f073-4375-bc79-8bff0df3a338 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:17.082666 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-0faf10fa-f073-4375-bc79-8bff0df3a338 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:17.093973 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0faf10fa-f073-4375-bc79-8bff0df3a338 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:17.094940 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0faf10fa-f073-4375-bc79-8bff0df3a338 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:17.095942 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0faf10fa-f073-4375-bc79-8bff0df3a338 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:17.096611 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0faf10fa-f073-4375-bc79-8bff0df3a338 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:17.223522 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-0faf10fa-f073-4375-bc79-8bff0df3a338 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 23509 microversion: 2.1 time: 0.147028 May 27 03:42:17.228310 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 122/228] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:42:17 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 23509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:42:17.357026 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-2ee4beab-2c0d-4173-a2d0-971ce7ea63ee tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:17.357756 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-2ee4beab-2c0d-4173-a2d0-971ce7ea63ee tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: e3449057-b2c6-4b15-b705-4076eddfefff] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:17.366399 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2ee4beab-2c0d-4173-a2d0-971ce7ea63ee tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:17.366852 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2ee4beab-2c0d-4173-a2d0-971ce7ea63ee tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:17.367655 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2ee4beab-2c0d-4173-a2d0-971ce7ea63ee tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:17.368091 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2ee4beab-2c0d-4173-a2d0-971ce7ea63ee tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:17.578393 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-2ee4beab-2c0d-4173-a2d0-971ce7ea63ee tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:17.588577 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-2ee4beab-2c0d-4173-a2d0-971ce7ea63ee tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff" status: 200 len: 1523 microversion: 2.1 time: 0.235509 May 27 03:42:17.589146 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 107/229] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:42:17 2021] GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff => generated 1523 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:17.917832 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-5557a14e-1e28-4258-ad69-5a8f942b09d7 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:17.919486 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-5557a14e-1e28-4258-ad69-5a8f942b09d7 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:17.927747 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-5557a14e-1e28-4258-ad69-5a8f942b09d7 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:17.928200 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-5557a14e-1e28-4258-ad69-5a8f942b09d7 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:17.929069 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-5557a14e-1e28-4258-ad69-5a8f942b09d7 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:17.929505 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-5557a14e-1e28-4258-ad69-5a8f942b09d7 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:18.058556 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-5557a14e-1e28-4258-ad69-5a8f942b09d7 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 22211 microversion: 2.20 time: 0.142101 May 27 03:42:18.058556 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 123/230] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:42:17 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 22211 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:42:18.235016 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-4680e13c-5b67-4110-8e52-a94749d8dc02 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:18.236799 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-4680e13c-5b67-4110-8e52-a94749d8dc02 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:18.246772 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-4680e13c-5b67-4110-8e52-a94749d8dc02 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:18.247226 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-4680e13c-5b67-4110-8e52-a94749d8dc02 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:18.248003 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-4680e13c-5b67-4110-8e52-a94749d8dc02 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:18.251216 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-4680e13c-5b67-4110-8e52-a94749d8dc02 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:18.375470 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-4680e13c-5b67-4110-8e52-a94749d8dc02 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 24651 microversion: 2.1 time: 0.143986 May 27 03:42:18.376444 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 108/231] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:42:18 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 24651 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:42:18.608493 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-6d604f06-abb7-4283-9da2-5247c938fd88 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:18.610059 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-6d604f06-abb7-4283-9da2-5247c938fd88 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: e3449057-b2c6-4b15-b705-4076eddfefff] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:18.628657 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6d604f06-abb7-4283-9da2-5247c938fd88 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:18.629895 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6d604f06-abb7-4283-9da2-5247c938fd88 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:18.633256 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6d604f06-abb7-4283-9da2-5247c938fd88 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:18.633927 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6d604f06-abb7-4283-9da2-5247c938fd88 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:19.002806 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-6d604f06-abb7-4283-9da2-5247c938fd88 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:19.018586 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-6d604f06-abb7-4283-9da2-5247c938fd88 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff" status: 200 len: 1523 microversion: 2.1 time: 0.416073 May 27 03:42:19.020752 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 124/232] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:42:18 2021] GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff => generated 1523 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:19.068732 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-c1ac7385-b528-4798-ac42-d9222b2f5000 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:19.069693 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-c1ac7385-b528-4798-ac42-d9222b2f5000 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:19.081131 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c1ac7385-b528-4798-ac42-d9222b2f5000 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:19.081595 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c1ac7385-b528-4798-ac42-d9222b2f5000 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:19.082469 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c1ac7385-b528-4798-ac42-d9222b2f5000 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:19.082799 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c1ac7385-b528-4798-ac42-d9222b2f5000 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:19.288254 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-c1ac7385-b528-4798-ac42-d9222b2f5000 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 23793 microversion: 2.20 time: 0.223871 May 27 03:42:19.289184 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 109/233] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:42:19 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 23793 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 27 03:42:19.393028 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-8a9f0703-a965-458a-902b-06404bca5cd4 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:19.394130 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-8a9f0703-a965-458a-902b-06404bca5cd4 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:19.405969 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8a9f0703-a965-458a-902b-06404bca5cd4 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:19.413434 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8a9f0703-a965-458a-902b-06404bca5cd4 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:19.413434 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8a9f0703-a965-458a-902b-06404bca5cd4 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:19.413434 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8a9f0703-a965-458a-902b-06404bca5cd4 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:19.489622 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-b7387521-7aac-42c3-ba5c-bc39712bb684 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1617802797", "imageRef": "78c0913d-0e41-4b41-b38f-f45c4f2535ff", "flavorRef": "452", "networks": [{"uuid": "9d88eb5c-a234-4a0b-9721-bcab674f53e1"}]}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:19.534885 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-8a9f0703-a965-458a-902b-06404bca5cd4 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 25893 microversion: 2.1 time: 0.145434 May 27 03:42:19.539212 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 125/234] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:42:19 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 25893 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:42:19.574468 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.network.neutron [None req-b7387521-7aac-42c3-ba5c-bc39712bb684 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] validate_networks() for [('9d88eb5c-a234-4a0b-9721-bcab674f53e1', None, None, None)] {{(pid=113021) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 27 03:42:20.036655 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-188172dd-52b0-4bff-bbc8-4600f4bd330e tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:20.046600 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-188172dd-52b0-4bff-bbc8-4600f4bd330e tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: e3449057-b2c6-4b15-b705-4076eddfefff] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:20.075480 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-188172dd-52b0-4bff-bbc8-4600f4bd330e tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:20.076196 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-188172dd-52b0-4bff-bbc8-4600f4bd330e tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:20.079402 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-188172dd-52b0-4bff-bbc8-4600f4bd330e tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:20.080714 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-188172dd-52b0-4bff-bbc8-4600f4bd330e tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:20.403410 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-188172dd-52b0-4bff-bbc8-4600f4bd330e tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:20.412610 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-188172dd-52b0-4bff-bbc8-4600f4bd330e tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff" status: 200 len: 1523 microversion: 2.1 time: 0.380503 May 27 03:42:20.413802 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 126/235] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:42:20 2021] GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff => generated 1523 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:42:20.418918 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-74211a4d-8d45-4ea6-a0ce-986efc30f949 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:20.420034 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-74211a4d-8d45-4ea6-a0ce-986efc30f949 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:20.428737 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-74211a4d-8d45-4ea6-a0ce-986efc30f949 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:20.429313 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-74211a4d-8d45-4ea6-a0ce-986efc30f949 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:20.430203 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-74211a4d-8d45-4ea6-a0ce-986efc30f949 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:20.430646 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-74211a4d-8d45-4ea6-a0ce-986efc30f949 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:20.558033 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-74211a4d-8d45-4ea6-a0ce-986efc30f949 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 25238 microversion: 2.20 time: 0.142682 May 27 03:42:20.559177 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 127/236] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:42:20 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 25238 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:42:20.565433 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-5364a446-4334-4acd-8386-667a75ed5582 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:20.566862 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-5364a446-4334-4acd-8386-667a75ed5582 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:20.577731 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-5364a446-4334-4acd-8386-667a75ed5582 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:20.578687 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-5364a446-4334-4acd-8386-667a75ed5582 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:20.587413 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-5364a446-4334-4acd-8386-667a75ed5582 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:20.587413 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-5364a446-4334-4acd-8386-667a75ed5582 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:20.693044 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-5364a446-4334-4acd-8386-667a75ed5582 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 26783 microversion: 2.1 time: 0.131954 May 27 03:42:20.701819 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 128/237] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:42:20 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 26783 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:42:20.952580 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.virt.hardware [None req-b7387521-7aac-42c3-ba5c-bc39712bb684 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Flavor limits 0:0:0 {{(pid=113021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 27 03:42:20.953297 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.virt.hardware [None req-b7387521-7aac-42c3-ba5c-bc39712bb684 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Image limits 0:0:0 {{(pid=113021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 27 03:42:20.953880 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.virt.hardware [None req-b7387521-7aac-42c3-ba5c-bc39712bb684 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Flavor pref 0:0:0 {{(pid=113021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 27 03:42:20.954434 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.virt.hardware [None req-b7387521-7aac-42c3-ba5c-bc39712bb684 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Image pref 0:0:0 {{(pid=113021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 27 03:42:20.954722 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.virt.hardware [None req-b7387521-7aac-42c3-ba5c-bc39712bb684 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=113021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 27 03:42:20.963548 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b7387521-7aac-42c3-ba5c-bc39712bb684 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:20.964009 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b7387521-7aac-42c3-ba5c-bc39712bb684 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:20.964865 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b7387521-7aac-42c3-ba5c-bc39712bb684 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:20.965482 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b7387521-7aac-42c3-ba5c-bc39712bb684 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:20.984032 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.quota [None req-b7387521-7aac-42c3-ba5c-bc39712bb684 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Getting quotas for project 7413f58ffa8e476fb5600cbc51ee9d34. Resources: {'instances', 'cores', 'ram'} {{(pid=113021) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 27 03:42:20.994445 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.quota [None req-b7387521-7aac-42c3-ba5c-bc39712bb684 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Getting quotas for user 925b5b18987f4e1eac67fda030a1714a and project 7413f58ffa8e476fb5600cbc51ee9d34. Resources: {'instances', 'cores', 'ram'} {{(pid=113021) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 27 03:42:21.000593 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-b7387521-7aac-42c3-ba5c-bc39712bb684 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Going to run 1 instances... {{(pid=113021) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 27 03:42:21.003070 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-b7387521-7aac-42c3-ba5c-bc39712bb684 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 6ad4e5b6-865b-4cda-ade3-c3eb357ec57e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78c0913d-0e41-4b41-b38f-f45c4f2535ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=113021) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 27 03:42:21.152963 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-b7387521-7aac-42c3-ba5c-bc39712bb684 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.670860 May 27 03:42:21.154611 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 110/238] 10.222.0.25 () {60 vars in 1147 bytes} [Thu May 27 03:42:19 2021] POST /compute/v2.1/servers => generated 380 bytes in 1674 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 03:42:21.165474 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-119859d3-45cd-4c87-a9f6-fcb2075538ee tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:21.166191 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-119859d3-45cd-4c87-a9f6-fcb2075538ee tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 6ad4e5b6-865b-4cda-ade3-c3eb357ec57e] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:21.261406 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-119859d3-45cd-4c87-a9f6-fcb2075538ee tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:21.270200 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-119859d3-45cd-4c87-a9f6-fcb2075538ee tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/6ad4e5b6-865b-4cda-ade3-c3eb357ec57e" status: 200 len: 1218 microversion: 2.1 time: 0.109706 May 27 03:42:21.281719 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 129/239] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:42:21 2021] GET /compute/v2.1/servers/6ad4e5b6-865b-4cda-ade3-c3eb357ec57e => generated 1218 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:21.430836 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-8862e073-938a-4dfd-b6b9-29171b142899 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:21.431368 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-8862e073-938a-4dfd-b6b9-29171b142899 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: e3449057-b2c6-4b15-b705-4076eddfefff] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:21.439360 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8862e073-938a-4dfd-b6b9-29171b142899 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:21.439817 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8862e073-938a-4dfd-b6b9-29171b142899 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:21.440621 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8862e073-938a-4dfd-b6b9-29171b142899 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:21.441120 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8862e073-938a-4dfd-b6b9-29171b142899 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:21.570081 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-9545d1f2-bad8-4f09-a6ff-15aa10ed814e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:21.571230 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-9545d1f2-bad8-4f09-a6ff-15aa10ed814e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:21.587221 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9545d1f2-bad8-4f09-a6ff-15aa10ed814e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:21.587942 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9545d1f2-bad8-4f09-a6ff-15aa10ed814e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:21.588990 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9545d1f2-bad8-4f09-a6ff-15aa10ed814e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:21.589676 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9545d1f2-bad8-4f09-a6ff-15aa10ed814e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:21.712788 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-9545d1f2-bad8-4f09-a6ff-15aa10ed814e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 26254 microversion: 2.20 time: 0.146453 May 27 03:42:21.717411 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 130/240] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:42:21 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 26254 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 27 03:42:21.728206 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-36085a82-0925-4176-82c5-b6da93ce863a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:21.731022 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-36085a82-0925-4176-82c5-b6da93ce863a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:21.744439 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-36085a82-0925-4176-82c5-b6da93ce863a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:21.746016 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-36085a82-0925-4176-82c5-b6da93ce863a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:21.747356 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-36085a82-0925-4176-82c5-b6da93ce863a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:21.748089 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-36085a82-0925-4176-82c5-b6da93ce863a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:21.929871 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-8862e073-938a-4dfd-b6b9-29171b142899 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:21.937358 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-36085a82-0925-4176-82c5-b6da93ce863a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 27468 microversion: 2.1 time: 0.216082 May 27 03:42:21.938986 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 131/241] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:42:21 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 27468 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:42:21.946667 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-8862e073-938a-4dfd-b6b9-29171b142899 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff" status: 200 len: 1523 microversion: 2.1 time: 0.519871 May 27 03:42:21.957209 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 111/242] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:42:21 2021] GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff => generated 1523 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:22.287462 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-6101473d-98f8-4097-bf23-2d259930d0e4 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:22.288167 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-6101473d-98f8-4097-bf23-2d259930d0e4 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 6ad4e5b6-865b-4cda-ade3-c3eb357ec57e] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:22.302075 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6101473d-98f8-4097-bf23-2d259930d0e4 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:22.303346 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6101473d-98f8-4097-bf23-2d259930d0e4 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:22.310576 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6101473d-98f8-4097-bf23-2d259930d0e4 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:22.313492 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6101473d-98f8-4097-bf23-2d259930d0e4 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:22.495132 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-6101473d-98f8-4097-bf23-2d259930d0e4 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:22.505500 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-6101473d-98f8-4097-bf23-2d259930d0e4 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/6ad4e5b6-865b-4cda-ade3-c3eb357ec57e" status: 200 len: 1222 microversion: 2.1 time: 0.222061 May 27 03:42:22.506214 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 132/243] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:42:22 2021] GET /compute/v2.1/servers/6ad4e5b6-865b-4cda-ade3-c3eb357ec57e => generated 1222 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:22.725240 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-b827ddd4-0c82-4085-b49e-78f0f115bc1d tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:22.726558 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-b827ddd4-0c82-4085-b49e-78f0f115bc1d tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:22.736227 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b827ddd4-0c82-4085-b49e-78f0f115bc1d tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:22.736973 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b827ddd4-0c82-4085-b49e-78f0f115bc1d tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:22.737977 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b827ddd4-0c82-4085-b49e-78f0f115bc1d tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:22.738577 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b827ddd4-0c82-4085-b49e-78f0f115bc1d tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:22.848659 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-b827ddd4-0c82-4085-b49e-78f0f115bc1d tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 27119 microversion: 2.20 time: 0.126730 May 27 03:42:22.849927 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 112/244] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:42:22 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 27119 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:42:22.953038 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-f9395bf5-e4fa-4336-8d03-6a9c8e942c8d tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:22.954804 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-f9395bf5-e4fa-4336-8d03-6a9c8e942c8d tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:22.973837 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-abfabf41-a644-45c9-89e8-7d944f6f497c tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:22.976199 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f9395bf5-e4fa-4336-8d03-6a9c8e942c8d tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:22.977170 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-abfabf41-a644-45c9-89e8-7d944f6f497c tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: e3449057-b2c6-4b15-b705-4076eddfefff] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:22.977712 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f9395bf5-e4fa-4336-8d03-6a9c8e942c8d tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:22.978665 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f9395bf5-e4fa-4336-8d03-6a9c8e942c8d tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:22.980572 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f9395bf5-e4fa-4336-8d03-6a9c8e942c8d tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:23.002124 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-abfabf41-a644-45c9-89e8-7d944f6f497c tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:23.003488 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-abfabf41-a644-45c9-89e8-7d944f6f497c tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:23.005078 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-abfabf41-a644-45c9-89e8-7d944f6f497c tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:23.008896 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-abfabf41-a644-45c9-89e8-7d944f6f497c tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:23.157866 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-f9395bf5-e4fa-4336-8d03-6a9c8e942c8d tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 27718 microversion: 2.1 time: 0.211771 May 27 03:42:23.158941 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 133/245] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:42:22 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 27718 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:42:23.322304 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-abfabf41-a644-45c9-89e8-7d944f6f497c tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:23.339687 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-abfabf41-a644-45c9-89e8-7d944f6f497c tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff" status: 200 len: 1523 microversion: 2.1 time: 0.377730 May 27 03:42:23.350366 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 113/246] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:42:22 2021] GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff => generated 1523 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:42:23.526996 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-593e304a-bc28-406c-8729-8847420737dd tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:23.528341 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-593e304a-bc28-406c-8729-8847420737dd tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 6ad4e5b6-865b-4cda-ade3-c3eb357ec57e] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:23.539409 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-593e304a-bc28-406c-8729-8847420737dd tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:23.540505 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-593e304a-bc28-406c-8729-8847420737dd tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:23.541684 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-593e304a-bc28-406c-8729-8847420737dd tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:23.548206 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-593e304a-bc28-406c-8729-8847420737dd tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:23.752855 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-593e304a-bc28-406c-8729-8847420737dd tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:23.766068 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-593e304a-bc28-406c-8729-8847420737dd tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/6ad4e5b6-865b-4cda-ade3-c3eb357ec57e" status: 200 len: 1278 microversion: 2.1 time: 0.247399 May 27 03:42:23.781237 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 134/247] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:42:23 2021] GET /compute/v2.1/servers/6ad4e5b6-865b-4cda-ade3-c3eb357ec57e => generated 1278 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:23.861474 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-eafe10b3-1108-4d75-89f9-0177039ecad2 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:23.862856 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-eafe10b3-1108-4d75-89f9-0177039ecad2 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:23.879275 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-eafe10b3-1108-4d75-89f9-0177039ecad2 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:23.881473 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-eafe10b3-1108-4d75-89f9-0177039ecad2 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:23.883354 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-eafe10b3-1108-4d75-89f9-0177039ecad2 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:23.885535 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-eafe10b3-1108-4d75-89f9-0177039ecad2 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:24.034309 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-eafe10b3-1108-4d75-89f9-0177039ecad2 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 27645 microversion: 2.20 time: 0.177375 May 27 03:42:24.036467 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 114/248] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:42:23 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 27645 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:42:24.174631 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-d1dfe1d4-87f9-45b1-8e47-ad31fc9164a7 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:24.177436 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-d1dfe1d4-87f9-45b1-8e47-ad31fc9164a7 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:24.207615 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d1dfe1d4-87f9-45b1-8e47-ad31fc9164a7 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:24.240452 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d1dfe1d4-87f9-45b1-8e47-ad31fc9164a7 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.037s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:24.242445 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d1dfe1d4-87f9-45b1-8e47-ad31fc9164a7 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:24.242908 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d1dfe1d4-87f9-45b1-8e47-ad31fc9164a7 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:24.359499 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-c77f173e-f6f2-4dcd-8def-e6e4b52e11af tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:24.359499 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-c77f173e-f6f2-4dcd-8def-e6e4b52e11af tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: e3449057-b2c6-4b15-b705-4076eddfefff] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:24.367904 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c77f173e-f6f2-4dcd-8def-e6e4b52e11af tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:24.368566 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c77f173e-f6f2-4dcd-8def-e6e4b52e11af tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:24.369614 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c77f173e-f6f2-4dcd-8def-e6e4b52e11af tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:24.370647 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c77f173e-f6f2-4dcd-8def-e6e4b52e11af tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:24.426183 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-d1dfe1d4-87f9-45b1-8e47-ad31fc9164a7 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28059 microversion: 2.1 time: 0.259333 May 27 03:42:24.427349 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 135/249] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:42:24 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28059 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:42:24.791260 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-92a1bc40-d228-43ff-b0db-1d7e881b5880 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:24.792270 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-92a1bc40-d228-43ff-b0db-1d7e881b5880 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 6ad4e5b6-865b-4cda-ade3-c3eb357ec57e] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:24.811273 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-92a1bc40-d228-43ff-b0db-1d7e881b5880 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:24.811770 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-92a1bc40-d228-43ff-b0db-1d7e881b5880 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:24.826553 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-92a1bc40-d228-43ff-b0db-1d7e881b5880 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:24.827882 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-92a1bc40-d228-43ff-b0db-1d7e881b5880 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:25.001934 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-c77f173e-f6f2-4dcd-8def-e6e4b52e11af tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:25.014167 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-c77f173e-f6f2-4dcd-8def-e6e4b52e11af tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff" status: 200 len: 1523 microversion: 2.1 time: 0.660329 May 27 03:42:25.015363 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 115/250] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:42:24 2021] GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff => generated 1523 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:42:25.047176 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-2c5ddae1-725c-4743-9847-2eb3f0869feb tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:25.048258 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-2c5ddae1-725c-4743-9847-2eb3f0869feb tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:25.065520 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2c5ddae1-725c-4743-9847-2eb3f0869feb tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:25.066237 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2c5ddae1-725c-4743-9847-2eb3f0869feb tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:25.067165 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2c5ddae1-725c-4743-9847-2eb3f0869feb tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:25.071243 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2c5ddae1-725c-4743-9847-2eb3f0869feb tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:25.209876 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-2c5ddae1-725c-4743-9847-2eb3f0869feb tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 27921 microversion: 2.20 time: 0.166239 May 27 03:42:25.213838 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 116/251] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:42:25 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 27921 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 27 03:42:25.380370 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-92a1bc40-d228-43ff-b0db-1d7e881b5880 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:25.398468 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-92a1bc40-d228-43ff-b0db-1d7e881b5880 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/6ad4e5b6-865b-4cda-ade3-c3eb357ec57e" status: 200 len: 1318 microversion: 2.1 time: 0.613348 May 27 03:42:25.402316 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 136/252] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:42:24 2021] GET /compute/v2.1/servers/6ad4e5b6-865b-4cda-ade3-c3eb357ec57e => generated 1318 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:42:25.448088 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-f2ff5f7a-1aa4-4396-aea9-23e794365dc4 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:25.452481 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-f2ff5f7a-1aa4-4396-aea9-23e794365dc4 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:25.472528 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f2ff5f7a-1aa4-4396-aea9-23e794365dc4 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:25.477580 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f2ff5f7a-1aa4-4396-aea9-23e794365dc4 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:25.479248 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f2ff5f7a-1aa4-4396-aea9-23e794365dc4 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:25.488213 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f2ff5f7a-1aa4-4396-aea9-23e794365dc4 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:25.676326 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-f2ff5f7a-1aa4-4396-aea9-23e794365dc4 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28125 microversion: 2.1 time: 0.241446 May 27 03:42:25.677886 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 117/253] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:42:25 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28125 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:42:26.033997 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-73c8da43-bf3f-4346-b9c1-89f547fa7b31 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:26.034712 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-73c8da43-bf3f-4346-b9c1-89f547fa7b31 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: e3449057-b2c6-4b15-b705-4076eddfefff] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:26.046634 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-73c8da43-bf3f-4346-b9c1-89f547fa7b31 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:26.047436 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-73c8da43-bf3f-4346-b9c1-89f547fa7b31 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:26.049190 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-73c8da43-bf3f-4346-b9c1-89f547fa7b31 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:26.049643 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-73c8da43-bf3f-4346-b9c1-89f547fa7b31 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:26.223393 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-c6f091ad-4e9a-402b-927e-38c6d1039868 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:26.224537 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-c6f091ad-4e9a-402b-927e-38c6d1039868 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:26.238851 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c6f091ad-4e9a-402b-927e-38c6d1039868 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:26.240509 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c6f091ad-4e9a-402b-927e-38c6d1039868 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:26.244221 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c6f091ad-4e9a-402b-927e-38c6d1039868 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:26.247876 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c6f091ad-4e9a-402b-927e-38c6d1039868 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:26.418378 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-c6f091ad-4e9a-402b-927e-38c6d1039868 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 27990 microversion: 2.20 time: 0.198980 May 27 03:42:26.422702 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-73c8da43-bf3f-4346-b9c1-89f547fa7b31 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:26.422870 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 118/254] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:42:26 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 27990 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:42:26.429033 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-73c8da43-bf3f-4346-b9c1-89f547fa7b31 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff" status: 200 len: 1523 microversion: 2.1 time: 0.400352 May 27 03:42:26.429603 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 137/255] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:42:26 2021] GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff => generated 1523 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:26.430226 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-5aa1ecdf-eee4-4dc0-bd2a-73bd8b91d13f tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:26.431122 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-5aa1ecdf-eee4-4dc0-bd2a-73bd8b91d13f tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 6ad4e5b6-865b-4cda-ade3-c3eb357ec57e] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:26.443513 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-5aa1ecdf-eee4-4dc0-bd2a-73bd8b91d13f tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:26.449894 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-5aa1ecdf-eee4-4dc0-bd2a-73bd8b91d13f tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:26.449894 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-5aa1ecdf-eee4-4dc0-bd2a-73bd8b91d13f tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:26.449894 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-5aa1ecdf-eee4-4dc0-bd2a-73bd8b91d13f tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:26.689952 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-a20ed697-e351-459a-8016-b83f334ab8db tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:26.690875 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-a20ed697-e351-459a-8016-b83f334ab8db tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:26.703004 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a20ed697-e351-459a-8016-b83f334ab8db tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:26.703450 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a20ed697-e351-459a-8016-b83f334ab8db tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:26.704220 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a20ed697-e351-459a-8016-b83f334ab8db tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:26.704678 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a20ed697-e351-459a-8016-b83f334ab8db tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:26.870813 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-a20ed697-e351-459a-8016-b83f334ab8db tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28242 microversion: 2.1 time: 0.184858 May 27 03:42:26.871578 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 138/256] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:42:26 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28242 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:42:26.982373 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-5aa1ecdf-eee4-4dc0-bd2a-73bd8b91d13f tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:26.995171 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-5aa1ecdf-eee4-4dc0-bd2a-73bd8b91d13f tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/6ad4e5b6-865b-4cda-ade3-c3eb357ec57e" status: 200 len: 1318 microversion: 2.1 time: 0.573963 May 27 03:42:27.006149 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 119/257] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:42:26 2021] GET /compute/v2.1/servers/6ad4e5b6-865b-4cda-ade3-c3eb357ec57e => generated 1318 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:27.295215 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [req-88f4d7be-8e69-4c2b-83df-21b646e2eb63 req-f47bfd8c-e558-4221-ad21-d3708c1a4f29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ad4e5b6-865b-4cda-ade3-c3eb357ec57e", "tag": "5c2e4b9a-b01a-446c-b193-369cb4a1319e"}]} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:27.296812 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:42:27.296812 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: warnings.warn(msg) May 27 03:42:27.318648 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-88f4d7be-8e69-4c2b-83df-21b646e2eb63 req-f47bfd8c-e558-4221-ad21-d3708c1a4f29 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:27.319125 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-88f4d7be-8e69-4c2b-83df-21b646e2eb63 req-f47bfd8c-e558-4221-ad21-d3708c1a4f29 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:27.352396 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.compute.server_external_events [req-88f4d7be-8e69-4c2b-83df-21b646e2eb63 req-f47bfd8c-e558-4221-ad21-d3708c1a4f29 service nova] Creating event network-changed:5c2e4b9a-b01a-446c-b193-369cb4a1319e for instance 6ad4e5b6-865b-4cda-ade3-c3eb357ec57e on hv-cinder-79326 May 27 03:42:27.358428 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [req-88f4d7be-8e69-4c2b-83df-21b646e2eb63 req-f47bfd8c-e558-4221-ad21-d3708c1a4f29 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067995 May 27 03:42:27.360590 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 139/258] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:42:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:42:27.430573 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-df549976-16d1-4d31-97c6-596b273f34df tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:27.434719 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-df549976-16d1-4d31-97c6-596b273f34df tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:27.443506 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-df549976-16d1-4d31-97c6-596b273f34df tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:27.448316 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-dc935a77-af8e-4fe9-99c0-b228975569eb tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:27.449059 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-dc935a77-af8e-4fe9-99c0-b228975569eb tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: e3449057-b2c6-4b15-b705-4076eddfefff] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:27.449389 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-df549976-16d1-4d31-97c6-596b273f34df tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:27.450579 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-df549976-16d1-4d31-97c6-596b273f34df tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:27.451175 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-df549976-16d1-4d31-97c6-596b273f34df tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:27.467112 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-dc935a77-af8e-4fe9-99c0-b228975569eb tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:27.471833 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-dc935a77-af8e-4fe9-99c0-b228975569eb tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:27.472846 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-dc935a77-af8e-4fe9-99c0-b228975569eb tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:27.473310 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-dc935a77-af8e-4fe9-99c0-b228975569eb tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:27.627621 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-df549976-16d1-4d31-97c6-596b273f34df tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 28239 microversion: 2.20 time: 0.200391 May 27 03:42:27.633361 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 120/259] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:42:27 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 28239 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:42:27.884457 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-ca278754-7924-43ad-92b0-3bcd1081c2b5 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:27.886974 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-ca278754-7924-43ad-92b0-3bcd1081c2b5 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:27.899454 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ca278754-7924-43ad-92b0-3bcd1081c2b5 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:27.900127 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ca278754-7924-43ad-92b0-3bcd1081c2b5 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:27.901432 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ca278754-7924-43ad-92b0-3bcd1081c2b5 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:27.902016 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ca278754-7924-43ad-92b0-3bcd1081c2b5 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:28.005976 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-dc935a77-af8e-4fe9-99c0-b228975569eb tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:28.024834 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-dc935a77-af8e-4fe9-99c0-b228975569eb tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff" status: 200 len: 1523 microversion: 2.1 time: 0.581618 May 27 03:42:28.034843 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 140/260] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:42:27 2021] GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff => generated 1523 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:28.039655 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-cb754e20-830b-4be1-a2b6-60a9baca078a tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:28.040273 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-cb754e20-830b-4be1-a2b6-60a9baca078a tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 6ad4e5b6-865b-4cda-ade3-c3eb357ec57e] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:28.057787 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-cb754e20-830b-4be1-a2b6-60a9baca078a tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:28.061166 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-cb754e20-830b-4be1-a2b6-60a9baca078a tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:28.061166 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-cb754e20-830b-4be1-a2b6-60a9baca078a tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:28.061166 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-cb754e20-830b-4be1-a2b6-60a9baca078a tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:28.113494 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-ca278754-7924-43ad-92b0-3bcd1081c2b5 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28242 microversion: 2.1 time: 0.233442 May 27 03:42:28.114613 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 121/261] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:42:27 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28242 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 03:42:28.536970 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-cb754e20-830b-4be1-a2b6-60a9baca078a tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:28.546844 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-cb754e20-830b-4be1-a2b6-60a9baca078a tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/6ad4e5b6-865b-4cda-ade3-c3eb357ec57e" status: 200 len: 1318 microversion: 2.1 time: 0.510848 May 27 03:42:28.547416 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 141/262] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:42:28 2021] GET /compute/v2.1/servers/6ad4e5b6-865b-4cda-ade3-c3eb357ec57e => generated 1318 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:28.642723 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-df9370af-2c41-455b-9609-98da58f01954 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:28.655229 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-df9370af-2c41-455b-9609-98da58f01954 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:28.670649 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-df9370af-2c41-455b-9609-98da58f01954 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:28.671115 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-df9370af-2c41-455b-9609-98da58f01954 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:28.671927 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-df9370af-2c41-455b-9609-98da58f01954 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:28.676797 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-df9370af-2c41-455b-9609-98da58f01954 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:28.840697 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-df9370af-2c41-455b-9609-98da58f01954 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 28239 microversion: 2.20 time: 0.203611 May 27 03:42:28.845634 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 122/263] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:42:28 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 28239 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:42:29.041576 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-c9e2e256-fe74-42bd-a2c9-dfda9aead785 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:29.042446 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-c9e2e256-fe74-42bd-a2c9-dfda9aead785 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: e3449057-b2c6-4b15-b705-4076eddfefff] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:29.060912 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c9e2e256-fe74-42bd-a2c9-dfda9aead785 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:29.064136 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c9e2e256-fe74-42bd-a2c9-dfda9aead785 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:29.064136 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c9e2e256-fe74-42bd-a2c9-dfda9aead785 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:29.068257 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c9e2e256-fe74-42bd-a2c9-dfda9aead785 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:29.128183 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-337dd664-4c4b-49dc-a9a8-a2913773c9ed tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:29.129782 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-337dd664-4c4b-49dc-a9a8-a2913773c9ed tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:29.155525 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-337dd664-4c4b-49dc-a9a8-a2913773c9ed tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:29.156214 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-337dd664-4c4b-49dc-a9a8-a2913773c9ed tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:29.157193 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-337dd664-4c4b-49dc-a9a8-a2913773c9ed tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:29.157783 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-337dd664-4c4b-49dc-a9a8-a2913773c9ed tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:29.364243 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-c9e2e256-fe74-42bd-a2c9-dfda9aead785 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:29.374605 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-337dd664-4c4b-49dc-a9a8-a2913773c9ed tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28242 microversion: 2.1 time: 0.252348 May 27 03:42:29.378547 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 123/264] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:42:29 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28242 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:42:29.390398 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-c9e2e256-fe74-42bd-a2c9-dfda9aead785 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff" status: 200 len: 1523 microversion: 2.1 time: 0.352463 May 27 03:42:29.395141 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 142/265] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:42:29 2021] GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff => generated 1523 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:29.570277 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-a4545d1a-e96b-457d-b1bc-4854d13ddd25 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:29.570277 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-a4545d1a-e96b-457d-b1bc-4854d13ddd25 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 6ad4e5b6-865b-4cda-ade3-c3eb357ec57e] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:29.573669 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a4545d1a-e96b-457d-b1bc-4854d13ddd25 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:29.574132 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a4545d1a-e96b-457d-b1bc-4854d13ddd25 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:29.574986 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a4545d1a-e96b-457d-b1bc-4854d13ddd25 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:29.575436 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a4545d1a-e96b-457d-b1bc-4854d13ddd25 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:29.854301 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-ccb0ed43-5067-4443-aaa9-ce3d93583b06 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:29.854301 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-ccb0ed43-5067-4443-aaa9-ce3d93583b06 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:29.864966 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ccb0ed43-5067-4443-aaa9-ce3d93583b06 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:29.865416 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ccb0ed43-5067-4443-aaa9-ce3d93583b06 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:29.874261 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ccb0ed43-5067-4443-aaa9-ce3d93583b06 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:29.874722 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ccb0ed43-5067-4443-aaa9-ce3d93583b06 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:30.048767 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-a4545d1a-e96b-457d-b1bc-4854d13ddd25 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:30.058344 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-a4545d1a-e96b-457d-b1bc-4854d13ddd25 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/6ad4e5b6-865b-4cda-ade3-c3eb357ec57e" status: 200 len: 1318 microversion: 2.1 time: 0.498856 May 27 03:42:30.061603 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 124/266] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:42:29 2021] GET /compute/v2.1/servers/6ad4e5b6-865b-4cda-ade3-c3eb357ec57e => generated 1318 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:30.082279 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-ccb0ed43-5067-4443-aaa9-ce3d93583b06 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 28239 microversion: 2.20 time: 0.233594 May 27 03:42:30.085960 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 143/267] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:42:29 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 28239 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 27 03:42:30.387083 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-bea1cde9-4e28-4c5d-8772-c8911d9e14a1 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:30.389270 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-bea1cde9-4e28-4c5d-8772-c8911d9e14a1 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:30.401755 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-bea1cde9-4e28-4c5d-8772-c8911d9e14a1 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:30.403152 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-bea1cde9-4e28-4c5d-8772-c8911d9e14a1 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:30.404230 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-bea1cde9-4e28-4c5d-8772-c8911d9e14a1 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:30.405399 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-bea1cde9-4e28-4c5d-8772-c8911d9e14a1 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:30.413634 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-61c3da4c-d225-4f6c-bd15-dcc50c009e8e tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:30.414619 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-61c3da4c-d225-4f6c-bd15-dcc50c009e8e tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: e3449057-b2c6-4b15-b705-4076eddfefff] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:30.424612 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-61c3da4c-d225-4f6c-bd15-dcc50c009e8e tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:30.425305 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-61c3da4c-d225-4f6c-bd15-dcc50c009e8e tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:30.426956 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-61c3da4c-d225-4f6c-bd15-dcc50c009e8e tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:30.430071 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-61c3da4c-d225-4f6c-bd15-dcc50c009e8e tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:30.634110 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-bea1cde9-4e28-4c5d-8772-c8911d9e14a1 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28242 microversion: 2.1 time: 0.250722 May 27 03:42:30.640425 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 125/268] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:42:30 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28242 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:42:30.715363 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-61c3da4c-d225-4f6c-bd15-dcc50c009e8e tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:30.730113 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-61c3da4c-d225-4f6c-bd15-dcc50c009e8e tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff" status: 200 len: 1523 microversion: 2.1 time: 0.321486 May 27 03:42:30.731849 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 144/269] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:42:30 2021] GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff => generated 1523 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:31.078613 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-a695a0b6-a158-4794-a23e-4f162df7b9db tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:31.079813 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-a695a0b6-a158-4794-a23e-4f162df7b9db tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 6ad4e5b6-865b-4cda-ade3-c3eb357ec57e] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:31.101808 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-9c63a3bc-b21e-4a40-a26f-17bb0b6b4c77 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:31.103267 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-9c63a3bc-b21e-4a40-a26f-17bb0b6b4c77 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:31.111449 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9c63a3bc-b21e-4a40-a26f-17bb0b6b4c77 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:31.112989 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9c63a3bc-b21e-4a40-a26f-17bb0b6b4c77 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:31.115443 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9c63a3bc-b21e-4a40-a26f-17bb0b6b4c77 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:31.117323 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9c63a3bc-b21e-4a40-a26f-17bb0b6b4c77 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:31.117976 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a695a0b6-a158-4794-a23e-4f162df7b9db tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:31.122311 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a695a0b6-a158-4794-a23e-4f162df7b9db tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:31.123337 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a695a0b6-a158-4794-a23e-4f162df7b9db tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:31.125236 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a695a0b6-a158-4794-a23e-4f162df7b9db tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:31.381500 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-9c63a3bc-b21e-4a40-a26f-17bb0b6b4c77 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 28239 microversion: 2.20 time: 0.286346 May 27 03:42:31.384826 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 145/270] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:42:31 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 28239 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:42:31.647302 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-28980963-23e1-4251-afdb-89f1025fd97e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:31.648322 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-28980963-23e1-4251-afdb-89f1025fd97e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:31.660156 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-28980963-23e1-4251-afdb-89f1025fd97e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:31.660876 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-28980963-23e1-4251-afdb-89f1025fd97e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:31.661859 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-28980963-23e1-4251-afdb-89f1025fd97e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:31.662883 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-28980963-23e1-4251-afdb-89f1025fd97e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:31.751950 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-a695a0b6-a158-4794-a23e-4f162df7b9db tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:31.760301 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-a695a0b6-a158-4794-a23e-4f162df7b9db tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/6ad4e5b6-865b-4cda-ade3-c3eb357ec57e" status: 200 len: 1318 microversion: 2.1 time: 0.687294 May 27 03:42:31.760907 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 126/271] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:42:31 2021] GET /compute/v2.1/servers/6ad4e5b6-865b-4cda-ade3-c3eb357ec57e => generated 1318 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:31.765406 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-d3c03c82-84fe-4da1-a47e-368814db0fff tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:31.766012 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-d3c03c82-84fe-4da1-a47e-368814db0fff tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: e3449057-b2c6-4b15-b705-4076eddfefff] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:31.774155 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d3c03c82-84fe-4da1-a47e-368814db0fff tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:31.774939 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d3c03c82-84fe-4da1-a47e-368814db0fff tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:31.775503 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d3c03c82-84fe-4da1-a47e-368814db0fff tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:31.776130 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d3c03c82-84fe-4da1-a47e-368814db0fff tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:31.814766 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-28980963-23e1-4251-afdb-89f1025fd97e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28242 microversion: 2.1 time: 0.171644 May 27 03:42:31.815419 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 146/272] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:42:31 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28242 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:42:32.284603 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-d3c03c82-84fe-4da1-a47e-368814db0fff tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:32.296874 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-d3c03c82-84fe-4da1-a47e-368814db0fff tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff" status: 200 len: 1523 microversion: 2.1 time: 0.534753 May 27 03:42:32.297785 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 127/273] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:42:31 2021] GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff => generated 1523 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:32.395085 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-e34418ec-7335-49e0-ac11-bf514e1e5cac tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:32.395991 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-e34418ec-7335-49e0-ac11-bf514e1e5cac tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:32.412814 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e34418ec-7335-49e0-ac11-bf514e1e5cac tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:32.413554 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e34418ec-7335-49e0-ac11-bf514e1e5cac tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:32.415112 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e34418ec-7335-49e0-ac11-bf514e1e5cac tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:32.415776 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e34418ec-7335-49e0-ac11-bf514e1e5cac tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:32.595491 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-e34418ec-7335-49e0-ac11-bf514e1e5cac tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 28239 microversion: 2.20 time: 0.204884 May 27 03:42:32.596326 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 147/274] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:42:32 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 28239 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:42:32.777774 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-a83fd210-6d13-47b0-ba14-0bde5e7e3475 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:32.778596 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-a83fd210-6d13-47b0-ba14-0bde5e7e3475 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 6ad4e5b6-865b-4cda-ade3-c3eb357ec57e] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:32.790386 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a83fd210-6d13-47b0-ba14-0bde5e7e3475 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:32.791018 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a83fd210-6d13-47b0-ba14-0bde5e7e3475 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:32.792257 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a83fd210-6d13-47b0-ba14-0bde5e7e3475 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:32.792927 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a83fd210-6d13-47b0-ba14-0bde5e7e3475 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:32.830202 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-4d6f0584-af75-4969-a512-d1d0896f4b84 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:32.834694 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-4d6f0584-af75-4969-a512-d1d0896f4b84 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:32.849502 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4d6f0584-af75-4969-a512-d1d0896f4b84 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:32.857263 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4d6f0584-af75-4969-a512-d1d0896f4b84 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:32.857263 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4d6f0584-af75-4969-a512-d1d0896f4b84 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:32.857263 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4d6f0584-af75-4969-a512-d1d0896f4b84 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:32.971550 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-4d6f0584-af75-4969-a512-d1d0896f4b84 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28242 microversion: 2.1 time: 0.148195 May 27 03:42:32.975713 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 148/275] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:42:32 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28242 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:42:33.042669 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-a83fd210-6d13-47b0-ba14-0bde5e7e3475 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:33.050826 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-a83fd210-6d13-47b0-ba14-0bde5e7e3475 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/6ad4e5b6-865b-4cda-ade3-c3eb357ec57e" status: 200 len: 1318 microversion: 2.1 time: 0.277538 May 27 03:42:33.051391 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 128/276] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:42:32 2021] GET /compute/v2.1/servers/6ad4e5b6-865b-4cda-ade3-c3eb357ec57e => generated 1318 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:33.315796 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-7089fe68-20e0-4bc8-81d1-21d63c50b996 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:33.317111 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-7089fe68-20e0-4bc8-81d1-21d63c50b996 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: e3449057-b2c6-4b15-b705-4076eddfefff] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:33.328078 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7089fe68-20e0-4bc8-81d1-21d63c50b996 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:33.329108 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7089fe68-20e0-4bc8-81d1-21d63c50b996 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:33.330139 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7089fe68-20e0-4bc8-81d1-21d63c50b996 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:33.330733 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7089fe68-20e0-4bc8-81d1-21d63c50b996 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:33.608273 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-41c938c1-83de-410d-bf38-7eef626c828a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:33.610089 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-41c938c1-83de-410d-bf38-7eef626c828a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:33.618112 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-41c938c1-83de-410d-bf38-7eef626c828a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:33.618863 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-41c938c1-83de-410d-bf38-7eef626c828a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:33.620006 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-41c938c1-83de-410d-bf38-7eef626c828a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:33.620842 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-41c938c1-83de-410d-bf38-7eef626c828a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:33.729050 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-41c938c1-83de-410d-bf38-7eef626c828a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 28239 microversion: 2.20 time: 0.125109 May 27 03:42:33.730297 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 129/277] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:42:33 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 28239 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 27 03:42:33.779700 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-7089fe68-20e0-4bc8-81d1-21d63c50b996 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:33.790320 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-7089fe68-20e0-4bc8-81d1-21d63c50b996 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff" status: 200 len: 1503 microversion: 2.1 time: 0.479932 May 27 03:42:33.793235 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 149/278] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:42:33 2021] GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff => generated 1503 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:33.812147 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-97ec32ea-b05b-4248-8c3b-a99477162e42 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:33.813015 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-97ec32ea-b05b-4248-8c3b-a99477162e42 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:33.829639 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-97ec32ea-b05b-4248-8c3b-a99477162e42 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:33.829639 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-97ec32ea-b05b-4248-8c3b-a99477162e42 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:33.829639 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-97ec32ea-b05b-4248-8c3b-a99477162e42 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:33.832305 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-97ec32ea-b05b-4248-8c3b-a99477162e42 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:33.983873 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-226d1a6c-0ae0-4cdb-bb6c-29226503ccbe tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:33.985283 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-226d1a6c-0ae0-4cdb-bb6c-29226503ccbe tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:33.999155 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-226d1a6c-0ae0-4cdb-bb6c-29226503ccbe tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:34.000635 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-226d1a6c-0ae0-4cdb-bb6c-29226503ccbe tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:34.002790 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-226d1a6c-0ae0-4cdb-bb6c-29226503ccbe tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:34.003675 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-226d1a6c-0ae0-4cdb-bb6c-29226503ccbe tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:34.157894 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-226d1a6c-0ae0-4cdb-bb6c-29226503ccbe tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28242 microversion: 2.1 time: 0.178216 May 27 03:42:34.160224 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 150/279] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:42:33 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28242 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:42:34.173744 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-97ec32ea-b05b-4248-8c3b-a99477162e42 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:34.182686 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-8c0d970b-626c-43f7-a9bf-9591d8b794f7 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:34.185572 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-8c0d970b-626c-43f7-a9bf-9591d8b794f7 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 6ad4e5b6-865b-4cda-ade3-c3eb357ec57e] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:34.187774 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-97ec32ea-b05b-4248-8c3b-a99477162e42 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0" status: 200 len: 1517 microversion: 2.1 time: 0.380233 May 27 03:42:34.190300 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 130/280] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:42:33 2021] GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0 => generated 1517 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:34.196989 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8c0d970b-626c-43f7-a9bf-9591d8b794f7 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:34.197842 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8c0d970b-626c-43f7-a9bf-9591d8b794f7 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:34.198864 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8c0d970b-626c-43f7-a9bf-9591d8b794f7 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:34.199594 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8c0d970b-626c-43f7-a9bf-9591d8b794f7 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:34.577254 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-8c0d970b-626c-43f7-a9bf-9591d8b794f7 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:34.585735 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-8c0d970b-626c-43f7-a9bf-9591d8b794f7 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/6ad4e5b6-865b-4cda-ade3-c3eb357ec57e" status: 200 len: 1318 microversion: 2.1 time: 0.423733 May 27 03:42:34.586068 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 151/281] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:42:34 2021] GET /compute/v2.1/servers/6ad4e5b6-865b-4cda-ade3-c3eb357ec57e => generated 1318 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:34.741785 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-1fc688e9-d69b-4988-ad59-56cf91e24b1a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:34.742724 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-1fc688e9-d69b-4988-ad59-56cf91e24b1a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:34.766163 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1fc688e9-d69b-4988-ad59-56cf91e24b1a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:34.766742 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1fc688e9-d69b-4988-ad59-56cf91e24b1a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:34.767690 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1fc688e9-d69b-4988-ad59-56cf91e24b1a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:34.768135 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1fc688e9-d69b-4988-ad59-56cf91e24b1a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:34.934757 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-1fc688e9-d69b-4988-ad59-56cf91e24b1a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 28239 microversion: 2.20 time: 0.196372 May 27 03:42:34.935406 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 131/282] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:42:34 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 28239 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:42:35.173469 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-3cda1359-231e-4e0e-b741-d0628d9dea4e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:35.175046 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-3cda1359-231e-4e0e-b741-d0628d9dea4e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:35.185726 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3cda1359-231e-4e0e-b741-d0628d9dea4e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:35.186816 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3cda1359-231e-4e0e-b741-d0628d9dea4e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:35.187856 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3cda1359-231e-4e0e-b741-d0628d9dea4e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:35.188297 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3cda1359-231e-4e0e-b741-d0628d9dea4e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:35.429234 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-3cda1359-231e-4e0e-b741-d0628d9dea4e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28242 microversion: 2.1 time: 0.260495 May 27 03:42:35.430676 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 152/283] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:42:35 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28242 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:42:35.607687 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-dc38cf47-5a9d-439d-b3bd-5f45ee337bc6 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:35.607687 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-dc38cf47-5a9d-439d-b3bd-5f45ee337bc6 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 6ad4e5b6-865b-4cda-ade3-c3eb357ec57e] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:35.617530 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-dc38cf47-5a9d-439d-b3bd-5f45ee337bc6 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:35.618286 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-dc38cf47-5a9d-439d-b3bd-5f45ee337bc6 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:35.620046 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-dc38cf47-5a9d-439d-b3bd-5f45ee337bc6 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:35.620734 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-dc38cf47-5a9d-439d-b3bd-5f45ee337bc6 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:35.942154 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-dc38cf47-5a9d-439d-b3bd-5f45ee337bc6 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:35.947885 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-89df3595-0c41-4a8b-8086-caedd63c3582 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:35.948929 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-89df3595-0c41-4a8b-8086-caedd63c3582 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:35.950497 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-dc38cf47-5a9d-439d-b3bd-5f45ee337bc6 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/6ad4e5b6-865b-4cda-ade3-c3eb357ec57e" status: 200 len: 1318 microversion: 2.1 time: 0.351122 May 27 03:42:35.952486 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 132/284] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:42:35 2021] GET /compute/v2.1/servers/6ad4e5b6-865b-4cda-ade3-c3eb357ec57e => generated 1318 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:35.964729 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-89df3595-0c41-4a8b-8086-caedd63c3582 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:35.965617 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-89df3595-0c41-4a8b-8086-caedd63c3582 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:35.966633 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-89df3595-0c41-4a8b-8086-caedd63c3582 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:35.967922 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-89df3595-0c41-4a8b-8086-caedd63c3582 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:36.190920 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-89df3595-0c41-4a8b-8086-caedd63c3582 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 28239 microversion: 2.20 time: 0.247254 May 27 03:42:36.193605 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 153/285] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:42:35 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 28239 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:42:36.440873 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-64a0bd36-0e59-47ae-a6b4-fb2c827ebe2f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:36.441814 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-64a0bd36-0e59-47ae-a6b4-fb2c827ebe2f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:36.449494 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-64a0bd36-0e59-47ae-a6b4-fb2c827ebe2f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:36.450051 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-64a0bd36-0e59-47ae-a6b4-fb2c827ebe2f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:36.450845 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-64a0bd36-0e59-47ae-a6b4-fb2c827ebe2f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:36.451295 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-64a0bd36-0e59-47ae-a6b4-fb2c827ebe2f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:36.591757 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-64a0bd36-0e59-47ae-a6b4-fb2c827ebe2f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28242 microversion: 2.1 time: 0.154189 May 27 03:42:36.593709 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 133/286] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:42:36 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28242 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:42:36.724508 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-5409b544-b50e-42a0-a2bf-11803dc6c320 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:36.725584 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-5409b544-b50e-42a0-a2bf-11803dc6c320 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:36.734458 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-5409b544-b50e-42a0-a2bf-11803dc6c320 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:36.734921 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-5409b544-b50e-42a0-a2bf-11803dc6c320 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:36.735722 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-5409b544-b50e-42a0-a2bf-11803dc6c320 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:36.736535 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-5409b544-b50e-42a0-a2bf-11803dc6c320 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:36.822033 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.objects.instance [None req-5409b544-b50e-42a0-a2bf-11803dc6c320 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lazy-loading 'flavor' on Instance uuid 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0 {{(pid=113020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 27 03:42:36.973991 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-7bcb00fc-6a9f-4126-bb66-b05e1e9fd88e tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:36.974796 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-7bcb00fc-6a9f-4126-bb66-b05e1e9fd88e tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 6ad4e5b6-865b-4cda-ade3-c3eb357ec57e] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:36.990829 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-7bcb00fc-6a9f-4126-bb66-b05e1e9fd88e tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:36.990829 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-7bcb00fc-6a9f-4126-bb66-b05e1e9fd88e tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:37.003152 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-7bcb00fc-6a9f-4126-bb66-b05e1e9fd88e tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:37.003948 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-7bcb00fc-6a9f-4126-bb66-b05e1e9fd88e tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:37.233152 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-5409b544-b50e-42a0-a2bf-11803dc6c320 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "POST /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0/action" status: 200 len: 32 microversion: 2.1 time: 0.512522 May 27 03:42:37.234111 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 154/287] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:42:36 2021] POST /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0/action => generated 32 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 03:42:37.277592 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-7bcb00fc-6a9f-4126-bb66-b05e1e9fd88e tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:37.290739 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-7bcb00fc-6a9f-4126-bb66-b05e1e9fd88e tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/6ad4e5b6-865b-4cda-ade3-c3eb357ec57e" status: 200 len: 1318 microversion: 2.1 time: 0.325401 May 27 03:42:37.291292 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 134/288] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:42:36 2021] GET /compute/v2.1/servers/6ad4e5b6-865b-4cda-ade3-c3eb357ec57e => generated 1318 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:37.297701 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-7cf22ff9-286b-4fc7-88d5-9ef786dfe64d tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:37.302925 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-7cf22ff9-286b-4fc7-88d5-9ef786dfe64d tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:37.311740 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-7cf22ff9-286b-4fc7-88d5-9ef786dfe64d tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:37.312417 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-7cf22ff9-286b-4fc7-88d5-9ef786dfe64d tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:37.314784 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-7cf22ff9-286b-4fc7-88d5-9ef786dfe64d tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:37.315393 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-7cf22ff9-286b-4fc7-88d5-9ef786dfe64d tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:37.442655 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-7cf22ff9-286b-4fc7-88d5-9ef786dfe64d tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 28239 microversion: 2.20 time: 0.149195 May 27 03:42:37.447681 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 135/289] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:42:37 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 28239 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:42:37.454250 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-ca33c153-091c-4e0c-a586-113a1caae7b0 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:37.455798 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-ca33c153-091c-4e0c-a586-113a1caae7b0 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:37.464856 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ca33c153-091c-4e0c-a586-113a1caae7b0 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:37.465549 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ca33c153-091c-4e0c-a586-113a1caae7b0 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:37.466514 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ca33c153-091c-4e0c-a586-113a1caae7b0 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:37.467732 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ca33c153-091c-4e0c-a586-113a1caae7b0 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:37.556629 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-05c914ca-eca0-45ac-a4b0-317ef3df6af4 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Action: 'create', calling method: .version_select at 0x7f98892a8dc0>, body: {"keypair": {"name": "tempest-TestShelveInstance-448446547"}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:37.602736 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.quota [None req-05c914ca-eca0-45ac-a4b0-317ef3df6af4 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Getting quotas for project 450ff0f7a98a4ae385a74e4ddaf301ef. Resources: {'key_pairs'} {{(pid=113020) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 27 03:42:37.607600 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.quota [None req-05c914ca-eca0-45ac-a4b0-317ef3df6af4 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Getting quotas for user 023704e9bd7e4bfcace7a3fa2ec9d919 and project 450ff0f7a98a4ae385a74e4ddaf301ef. Resources: {'key_pairs'} {{(pid=113020) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 27 03:42:37.842911 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.quota [None req-05c914ca-eca0-45ac-a4b0-317ef3df6af4 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Getting quotas for project 450ff0f7a98a4ae385a74e4ddaf301ef. Resources: {'key_pairs'} {{(pid=113020) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 27 03:42:37.848056 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.quota [None req-05c914ca-eca0-45ac-a4b0-317ef3df6af4 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Getting quotas for user 023704e9bd7e4bfcace7a3fa2ec9d919 and project 450ff0f7a98a4ae385a74e4ddaf301ef. Resources: {'key_pairs'} {{(pid=113020) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 27 03:42:37.864265 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-05c914ca-eca0-45ac-a4b0-317ef3df6af4 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 2311 microversion: 2.1 time: 0.628562 May 27 03:42:37.865445 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 155/290] 10.222.0.25 () {60 vars in 1158 bytes} [Thu May 27 03:42:37 2021] POST /compute/v2.1/os-keypairs => generated 2311 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:37.878746 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-8f1372ca-6bbb-42c5-8ec7-f00db1f19250 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:37.880625 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-8f1372ca-6bbb-42c5-8ec7-f00db1f19250 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:37.890320 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8f1372ca-6bbb-42c5-8ec7-f00db1f19250 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:37.891090 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8f1372ca-6bbb-42c5-8ec7-f00db1f19250 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:37.892443 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8f1372ca-6bbb-42c5-8ec7-f00db1f19250 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:37.893139 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8f1372ca-6bbb-42c5-8ec7-f00db1f19250 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:38.000547 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-ca33c153-091c-4e0c-a586-113a1caae7b0 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:38.013137 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-ca33c153-091c-4e0c-a586-113a1caae7b0 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0" status: 200 len: 1523 microversion: 2.1 time: 0.564071 May 27 03:42:38.013984 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 136/291] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:42:37 2021] GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0 => generated 1523 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:38.039225 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-8f1372ca-6bbb-42c5-8ec7-f00db1f19250 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28242 microversion: 2.1 time: 0.171404 May 27 03:42:38.039225 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 156/292] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:42:37 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28242 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:42:38.312358 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-e964a081-bd3a-46c6-a173-2829d11fd081 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:38.313590 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-e964a081-bd3a-46c6-a173-2829d11fd081 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 6ad4e5b6-865b-4cda-ade3-c3eb357ec57e] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:38.322878 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e964a081-bd3a-46c6-a173-2829d11fd081 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:38.323890 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e964a081-bd3a-46c6-a173-2829d11fd081 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:38.325197 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e964a081-bd3a-46c6-a173-2829d11fd081 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:38.325867 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e964a081-bd3a-46c6-a173-2829d11fd081 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:38.456472 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-577b7458-d989-445e-8f84-9df078608e18 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:38.457939 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-577b7458-d989-445e-8f84-9df078608e18 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:38.476266 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-577b7458-d989-445e-8f84-9df078608e18 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:38.476965 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-577b7458-d989-445e-8f84-9df078608e18 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:38.478168 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-577b7458-d989-445e-8f84-9df078608e18 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:38.479354 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-577b7458-d989-445e-8f84-9df078608e18 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:38.626872 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-577b7458-d989-445e-8f84-9df078608e18 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 28239 microversion: 2.20 time: 0.174712 May 27 03:42:38.627529 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 157/293] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:42:38 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 28239 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:42:38.632629 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [req-c09b6614-8efd-42e3-b1c7-0ee92941265f req-6abc1a73-0ac7-4130-8aef-2eb9fc6b6c2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ad4e5b6-865b-4cda-ade3-c3eb357ec57e", "name": "network-vif-plugged", "status": "completed", "tag": "5c2e4b9a-b01a-446c-b193-369cb4a1319e"}]} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:38.634123 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:42:38.634123 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: warnings.warn(msg) May 27 03:42:38.643509 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-c09b6614-8efd-42e3-b1c7-0ee92941265f req-6abc1a73-0ac7-4130-8aef-2eb9fc6b6c2d service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:38.643959 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-c09b6614-8efd-42e3-b1c7-0ee92941265f req-6abc1a73-0ac7-4130-8aef-2eb9fc6b6c2d service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:38.663031 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.compute.server_external_events [req-c09b6614-8efd-42e3-b1c7-0ee92941265f req-6abc1a73-0ac7-4130-8aef-2eb9fc6b6c2d service nova] Creating event network-vif-plugged:5c2e4b9a-b01a-446c-b193-369cb4a1319e for instance 6ad4e5b6-865b-4cda-ade3-c3eb357ec57e on hv-cinder-79326 May 27 03:42:38.668716 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [req-c09b6614-8efd-42e3-b1c7-0ee92941265f req-6abc1a73-0ac7-4130-8aef-2eb9fc6b6c2d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039718 May 27 03:42:38.670980 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 158/294] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:42:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:42:38.699935 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-e964a081-bd3a-46c6-a173-2829d11fd081 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:38.710300 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-e964a081-bd3a-46c6-a173-2829d11fd081 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/6ad4e5b6-865b-4cda-ade3-c3eb357ec57e" status: 200 len: 1318 microversion: 2.1 time: 0.402873 May 27 03:42:38.711150 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 137/295] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:42:38 2021] GET /compute/v2.1/servers/6ad4e5b6-865b-4cda-ade3-c3eb357ec57e => generated 1318 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:39.031971 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-476efd48-f850-4679-954f-2acec37ee853 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:39.033086 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-476efd48-f850-4679-954f-2acec37ee853 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:39.051813 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-131e6a3d-9397-4995-b3c6-9b487bfc258f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:39.052896 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-131e6a3d-9397-4995-b3c6-9b487bfc258f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:39.067350 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-131e6a3d-9397-4995-b3c6-9b487bfc258f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:39.068158 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-131e6a3d-9397-4995-b3c6-9b487bfc258f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:39.070912 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-131e6a3d-9397-4995-b3c6-9b487bfc258f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:39.071590 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-131e6a3d-9397-4995-b3c6-9b487bfc258f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:39.072990 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-476efd48-f850-4679-954f-2acec37ee853 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:39.073648 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-476efd48-f850-4679-954f-2acec37ee853 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:39.075763 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-476efd48-f850-4679-954f-2acec37ee853 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:39.077764 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-476efd48-f850-4679-954f-2acec37ee853 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:39.208744 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-131e6a3d-9397-4995-b3c6-9b487bfc258f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28242 microversion: 2.1 time: 0.150239 May 27 03:42:39.208744 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 138/296] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:42:39 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28242 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 03:42:39.440835 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-476efd48-f850-4679-954f-2acec37ee853 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:39.452445 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-476efd48-f850-4679-954f-2acec37ee853 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0" status: 200 len: 1523 microversion: 2.1 time: 0.424898 May 27 03:42:39.462303 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 159/297] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:42:39 2021] GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0 => generated 1523 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:39.642962 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-e3debe8f-aae0-4c7d-8add-7a9fbe2a5062 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:39.642962 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-e3debe8f-aae0-4c7d-8add-7a9fbe2a5062 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:39.656646 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e3debe8f-aae0-4c7d-8add-7a9fbe2a5062 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:39.657523 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e3debe8f-aae0-4c7d-8add-7a9fbe2a5062 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:39.658455 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e3debe8f-aae0-4c7d-8add-7a9fbe2a5062 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:39.658893 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e3debe8f-aae0-4c7d-8add-7a9fbe2a5062 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:39.736317 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-d42494c8-078e-401c-937b-86d5c2e0dff5 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:39.736317 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-d42494c8-078e-401c-937b-86d5c2e0dff5 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 6ad4e5b6-865b-4cda-ade3-c3eb357ec57e] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:39.756081 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d42494c8-078e-401c-937b-86d5c2e0dff5 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:39.756694 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d42494c8-078e-401c-937b-86d5c2e0dff5 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:39.758479 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d42494c8-078e-401c-937b-86d5c2e0dff5 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:39.763204 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d42494c8-078e-401c-937b-86d5c2e0dff5 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:39.794683 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-e3debe8f-aae0-4c7d-8add-7a9fbe2a5062 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 28239 microversion: 2.20 time: 0.159611 May 27 03:42:39.796674 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 139/298] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:42:39 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 28239 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:42:40.034452 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-d42494c8-078e-401c-937b-86d5c2e0dff5 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:40.042917 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-d42494c8-078e-401c-937b-86d5c2e0dff5 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/6ad4e5b6-865b-4cda-ade3-c3eb357ec57e" status: 200 len: 1318 microversion: 2.1 time: 0.318619 May 27 03:42:40.043489 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 160/299] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:42:39 2021] GET /compute/v2.1/servers/6ad4e5b6-865b-4cda-ade3-c3eb357ec57e => generated 1318 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:40.211927 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-b424befb-e95c-46a7-ad50-a37bf8e754ce tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:40.212979 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-b424befb-e95c-46a7-ad50-a37bf8e754ce tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:40.225834 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b424befb-e95c-46a7-ad50-a37bf8e754ce tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:40.226301 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b424befb-e95c-46a7-ad50-a37bf8e754ce tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:40.227744 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b424befb-e95c-46a7-ad50-a37bf8e754ce tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:40.228875 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b424befb-e95c-46a7-ad50-a37bf8e754ce tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:40.368972 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-b424befb-e95c-46a7-ad50-a37bf8e754ce tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28242 microversion: 2.1 time: 0.160492 May 27 03:42:40.369623 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 140/300] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:42:40 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28242 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 03:42:40.470906 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-986c0203-6454-441d-9478-6a4bc1d66922 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:40.471706 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-986c0203-6454-441d-9478-6a4bc1d66922 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:40.486579 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-986c0203-6454-441d-9478-6a4bc1d66922 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:40.494422 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-986c0203-6454-441d-9478-6a4bc1d66922 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:40.494422 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-986c0203-6454-441d-9478-6a4bc1d66922 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:40.494422 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-986c0203-6454-441d-9478-6a4bc1d66922 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:40.744207 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-986c0203-6454-441d-9478-6a4bc1d66922 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:40.754494 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-986c0203-6454-441d-9478-6a4bc1d66922 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0" status: 200 len: 1523 microversion: 2.1 time: 0.288853 May 27 03:42:40.755229 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 161/301] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:42:40 2021] GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0 => generated 1523 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:40.808442 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-e98821dd-1313-436d-9361-acc40a915ef3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:40.809696 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-e98821dd-1313-436d-9361-acc40a915ef3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:40.820394 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e98821dd-1313-436d-9361-acc40a915ef3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:40.821110 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e98821dd-1313-436d-9361-acc40a915ef3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:40.822253 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e98821dd-1313-436d-9361-acc40a915ef3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:40.822848 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e98821dd-1313-436d-9361-acc40a915ef3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:40.943789 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-e98821dd-1313-436d-9361-acc40a915ef3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 28239 microversion: 2.20 time: 0.139791 May 27 03:42:40.945903 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 141/302] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:42:40 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 28239 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:42:41.059627 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-b9823574-5105-4693-9bcb-0a802a55c03e tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:41.060328 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-b9823574-5105-4693-9bcb-0a802a55c03e tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 6ad4e5b6-865b-4cda-ade3-c3eb357ec57e] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:41.076682 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b9823574-5105-4693-9bcb-0a802a55c03e tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:41.077147 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b9823574-5105-4693-9bcb-0a802a55c03e tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:41.077944 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b9823574-5105-4693-9bcb-0a802a55c03e tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:41.078384 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b9823574-5105-4693-9bcb-0a802a55c03e tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:41.344299 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-b9823574-5105-4693-9bcb-0a802a55c03e tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:41.360773 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-b9823574-5105-4693-9bcb-0a802a55c03e tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/6ad4e5b6-865b-4cda-ade3-c3eb357ec57e" status: 200 len: 1318 microversion: 2.1 time: 0.303327 May 27 03:42:41.364145 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 162/303] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:42:41 2021] GET /compute/v2.1/servers/6ad4e5b6-865b-4cda-ade3-c3eb357ec57e => generated 1318 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:41.381028 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-d9b1952c-d1aa-4ad0-a47e-f652ed69cf22 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:41.382674 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-d9b1952c-d1aa-4ad0-a47e-f652ed69cf22 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:41.393802 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d9b1952c-d1aa-4ad0-a47e-f652ed69cf22 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:41.394030 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d9b1952c-d1aa-4ad0-a47e-f652ed69cf22 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:41.395065 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d9b1952c-d1aa-4ad0-a47e-f652ed69cf22 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:41.400855 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d9b1952c-d1aa-4ad0-a47e-f652ed69cf22 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:41.533754 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-d9b1952c-d1aa-4ad0-a47e-f652ed69cf22 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28242 microversion: 2.1 time: 0.157136 May 27 03:42:41.535022 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 142/304] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:42:41 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28242 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 03:42:41.772273 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-8405b438-9829-44b7-9f66-8f09ab3f25a0 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:41.775000 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-8405b438-9829-44b7-9f66-8f09ab3f25a0 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:41.785225 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8405b438-9829-44b7-9f66-8f09ab3f25a0 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:41.785677 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8405b438-9829-44b7-9f66-8f09ab3f25a0 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:41.786567 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8405b438-9829-44b7-9f66-8f09ab3f25a0 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:41.787167 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8405b438-9829-44b7-9f66-8f09ab3f25a0 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:41.965145 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-44eef123-f6c7-45bd-94cc-5b69b7c917c0 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:41.966034 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-44eef123-f6c7-45bd-94cc-5b69b7c917c0 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:41.989204 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-44eef123-f6c7-45bd-94cc-5b69b7c917c0 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:41.997801 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-44eef123-f6c7-45bd-94cc-5b69b7c917c0 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:42.002361 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-44eef123-f6c7-45bd-94cc-5b69b7c917c0 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:42.003016 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-44eef123-f6c7-45bd-94cc-5b69b7c917c0 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:42.160083 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-44eef123-f6c7-45bd-94cc-5b69b7c917c0 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 28239 microversion: 2.20 time: 0.206763 May 27 03:42:42.164447 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 143/305] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:42:41 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 28239 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:42:42.177198 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-8405b438-9829-44b7-9f66-8f09ab3f25a0 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:42.191895 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-8405b438-9829-44b7-9f66-8f09ab3f25a0 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0" status: 200 len: 1523 microversion: 2.1 time: 0.423520 May 27 03:42:42.192920 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 163/306] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:42:41 2021] GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0 => generated 1523 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:42.391665 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-e5c4721a-f49a-45b3-860a-31eb3baad382 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:42.391665 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-e5c4721a-f49a-45b3-860a-31eb3baad382 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 6ad4e5b6-865b-4cda-ade3-c3eb357ec57e] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:42.391665 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e5c4721a-f49a-45b3-860a-31eb3baad382 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:42.391665 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e5c4721a-f49a-45b3-860a-31eb3baad382 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:42.392490 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e5c4721a-f49a-45b3-860a-31eb3baad382 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:42.392490 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e5c4721a-f49a-45b3-860a-31eb3baad382 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:42.546252 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-c4f78281-1bf9-4125-8d54-1371f794f619 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:42.547228 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-c4f78281-1bf9-4125-8d54-1371f794f619 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:42.554467 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c4f78281-1bf9-4125-8d54-1371f794f619 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:42.554912 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c4f78281-1bf9-4125-8d54-1371f794f619 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:42.555708 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c4f78281-1bf9-4125-8d54-1371f794f619 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:42.556143 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c4f78281-1bf9-4125-8d54-1371f794f619 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:42.595469 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-e5c4721a-f49a-45b3-860a-31eb3baad382 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:42.603987 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-e5c4721a-f49a-45b3-860a-31eb3baad382 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/6ad4e5b6-865b-4cda-ade3-c3eb357ec57e" status: 200 len: 1509 microversion: 2.1 time: 0.227394 May 27 03:42:42.609747 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 144/307] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:42:42 2021] GET /compute/v2.1/servers/6ad4e5b6-865b-4cda-ade3-c3eb357ec57e => generated 1509 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:42.670920 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-c4f78281-1bf9-4125-8d54-1371f794f619 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28242 microversion: 2.1 time: 0.128307 May 27 03:42:42.676618 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 164/308] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:42:42 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28242 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 03:42:43.173818 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-7d655e8a-e425-4663-971d-9d67fcf75328 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:43.174879 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-7d655e8a-e425-4663-971d-9d67fcf75328 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:43.182291 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-7d655e8a-e425-4663-971d-9d67fcf75328 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:43.182750 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-7d655e8a-e425-4663-971d-9d67fcf75328 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:43.187861 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-7d655e8a-e425-4663-971d-9d67fcf75328 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:43.187861 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-7d655e8a-e425-4663-971d-9d67fcf75328 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:43.210302 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-770bb147-b677-426f-95b1-d8334016fcea tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:43.210993 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-770bb147-b677-426f-95b1-d8334016fcea tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:43.236188 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-770bb147-b677-426f-95b1-d8334016fcea tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:43.236774 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-770bb147-b677-426f-95b1-d8334016fcea tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:43.238068 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-770bb147-b677-426f-95b1-d8334016fcea tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:43.239854 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-770bb147-b677-426f-95b1-d8334016fcea tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:43.347024 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-7d655e8a-e425-4663-971d-9d67fcf75328 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 28239 microversion: 2.20 time: 0.177382 May 27 03:42:43.351924 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 145/309] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:42:43 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 28239 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:42:43.677742 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-770bb147-b677-426f-95b1-d8334016fcea tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:43.683549 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-e512ba47-f06d-4e29-9579-38d37b23a94b tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:43.692622 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-e512ba47-f06d-4e29-9579-38d37b23a94b tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:43.692956 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-770bb147-b677-426f-95b1-d8334016fcea tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0" status: 200 len: 1523 microversion: 2.1 time: 0.481444 May 27 03:42:43.692956 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 165/310] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:42:43 2021] GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0 => generated 1523 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:42:43.699274 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e512ba47-f06d-4e29-9579-38d37b23a94b tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:43.699979 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e512ba47-f06d-4e29-9579-38d37b23a94b tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:43.700782 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e512ba47-f06d-4e29-9579-38d37b23a94b tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:43.701983 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e512ba47-f06d-4e29-9579-38d37b23a94b tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:43.805641 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-e512ba47-f06d-4e29-9579-38d37b23a94b tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28242 microversion: 2.1 time: 0.126401 May 27 03:42:43.808758 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 146/311] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:42:43 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28242 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 03:42:44.359793 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-7b0c7820-de41-4912-92ab-34a592447c37 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:44.360894 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-7b0c7820-de41-4912-92ab-34a592447c37 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:44.374225 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7b0c7820-de41-4912-92ab-34a592447c37 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:44.374225 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7b0c7820-de41-4912-92ab-34a592447c37 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:44.374225 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7b0c7820-de41-4912-92ab-34a592447c37 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:44.374225 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7b0c7820-de41-4912-92ab-34a592447c37 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:44.708819 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-ab06a4fb-0336-43f2-87ad-284c8d26c9f3 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:44.710346 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-ab06a4fb-0336-43f2-87ad-284c8d26c9f3 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:44.724038 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ab06a4fb-0336-43f2-87ad-284c8d26c9f3 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:44.725282 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ab06a4fb-0336-43f2-87ad-284c8d26c9f3 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:44.726523 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ab06a4fb-0336-43f2-87ad-284c8d26c9f3 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:44.736538 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ab06a4fb-0336-43f2-87ad-284c8d26c9f3 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:44.973022 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-ab06a4fb-0336-43f2-87ad-284c8d26c9f3 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:44.983187 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-ab06a4fb-0336-43f2-87ad-284c8d26c9f3 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0" status: 200 len: 1523 microversion: 2.1 time: 0.280691 May 27 03:42:44.992638 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 147/312] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:42:44 2021] GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0 => generated 1523 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:44.992638 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-f181ef35-5d3e-4a27-99c7-9d7e76339057 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:44.992638 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-f181ef35-5d3e-4a27-99c7-9d7e76339057 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:44.997884 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f181ef35-5d3e-4a27-99c7-9d7e76339057 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:44.998378 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f181ef35-5d3e-4a27-99c7-9d7e76339057 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:44.999162 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f181ef35-5d3e-4a27-99c7-9d7e76339057 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:44.999832 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f181ef35-5d3e-4a27-99c7-9d7e76339057 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:48.511986 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-f181ef35-5d3e-4a27-99c7-9d7e76339057 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28242 microversion: 2.1 time: 3.526897 May 27 03:42:48.512729 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 148/313] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:42:44 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28242 bytes in 3528 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:42:48.517789 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-7b0c7820-de41-4912-92ab-34a592447c37 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 28239 microversion: 2.20 time: 4.162453 May 27 03:42:48.519185 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 166/314] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:42:44 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 28239 bytes in 4165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:42:48.519687 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-5536d819-917e-4acd-816c-08fe80ae5b48 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:48.520413 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-5536d819-917e-4acd-816c-08fe80ae5b48 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:48.528781 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-5536d819-917e-4acd-816c-08fe80ae5b48 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:48.529907 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-5536d819-917e-4acd-816c-08fe80ae5b48 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:48.530697 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-5536d819-917e-4acd-816c-08fe80ae5b48 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:48.531143 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-5536d819-917e-4acd-816c-08fe80ae5b48 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:48.727924 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-5536d819-917e-4acd-816c-08fe80ae5b48 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:48.736129 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-5536d819-917e-4acd-816c-08fe80ae5b48 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0" status: 200 len: 1523 microversion: 2.1 time: 0.221698 May 27 03:42:48.736739 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 149/315] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:42:48 2021] GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0 => generated 1523 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:49.524837 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-5635f37e-a22c-48a5-ab43-fab46276e122 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:49.525869 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-5635f37e-a22c-48a5-ab43-fab46276e122 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:49.531264 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-48810ac6-ded0-4468-8547-f7b69dae750c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:49.532182 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-48810ac6-ded0-4468-8547-f7b69dae750c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:49.534388 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-5635f37e-a22c-48a5-ab43-fab46276e122 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:49.534849 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-5635f37e-a22c-48a5-ab43-fab46276e122 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:49.535627 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-5635f37e-a22c-48a5-ab43-fab46276e122 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:49.536068 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-5635f37e-a22c-48a5-ab43-fab46276e122 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:49.539633 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-48810ac6-ded0-4468-8547-f7b69dae750c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:49.540080 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-48810ac6-ded0-4468-8547-f7b69dae750c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:49.540870 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-48810ac6-ded0-4468-8547-f7b69dae750c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:49.541560 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-48810ac6-ded0-4468-8547-f7b69dae750c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:49.745436 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-5635f37e-a22c-48a5-ab43-fab46276e122 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28242 microversion: 2.1 time: 0.224648 May 27 03:42:49.746083 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 167/316] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:42:49 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28242 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:42:49.750164 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-48810ac6-ded0-4468-8547-f7b69dae750c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 28239 microversion: 2.20 time: 0.223235 May 27 03:42:49.753872 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 150/317] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:42:49 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 28239 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:42:49.754027 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-e8989908-0b31-415d-892e-aafbf3b86f7d tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:49.754466 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-e8989908-0b31-415d-892e-aafbf3b86f7d tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:49.762524 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e8989908-0b31-415d-892e-aafbf3b86f7d tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:49.762981 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e8989908-0b31-415d-892e-aafbf3b86f7d tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:49.764439 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e8989908-0b31-415d-892e-aafbf3b86f7d tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:49.764886 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e8989908-0b31-415d-892e-aafbf3b86f7d tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:50.183869 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-e8989908-0b31-415d-892e-aafbf3b86f7d tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:50.192511 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-e8989908-0b31-415d-892e-aafbf3b86f7d tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0" status: 200 len: 1523 microversion: 2.1 time: 0.442487 May 27 03:42:50.193096 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 168/318] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:42:49 2021] GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0 => generated 1523 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:42:50.759220 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-b12521b2-107e-4e49-accf-4a0e7fd2f5ae tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:50.760390 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-c4f18a71-f045-4808-9ae7-62d8529c87db tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:50.761660 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-b12521b2-107e-4e49-accf-4a0e7fd2f5ae tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:50.762016 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-c4f18a71-f045-4808-9ae7-62d8529c87db tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:50.770910 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b12521b2-107e-4e49-accf-4a0e7fd2f5ae tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:50.771587 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b12521b2-107e-4e49-accf-4a0e7fd2f5ae tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:50.772132 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c4f18a71-f045-4808-9ae7-62d8529c87db tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:50.772723 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c4f18a71-f045-4808-9ae7-62d8529c87db tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:50.772917 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b12521b2-107e-4e49-accf-4a0e7fd2f5ae tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:50.773519 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b12521b2-107e-4e49-accf-4a0e7fd2f5ae tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:50.774051 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c4f18a71-f045-4808-9ae7-62d8529c87db tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:50.774728 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c4f18a71-f045-4808-9ae7-62d8529c87db tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:50.903157 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-c4f18a71-f045-4808-9ae7-62d8529c87db tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 28239 microversion: 2.20 time: 0.146257 May 27 03:42:50.903797 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 169/319] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:42:50 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 28239 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:42:50.909502 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-e3c61207-1a58-4aca-8ce8-861b507b1d76 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d79e3521-131c-4fd5-a11c-8d7b4e4da17a"}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:50.910653 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-e3c61207-1a58-4aca-8ce8-861b507b1d76 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 6ad4e5b6-865b-4cda-ade3-c3eb357ec57e] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:50.917641 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-b12521b2-107e-4e49-accf-4a0e7fd2f5ae tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28242 microversion: 2.1 time: 0.162754 May 27 03:42:50.918290 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 151/320] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:42:50 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28242 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:42:50.918757 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e3c61207-1a58-4aca-8ce8-861b507b1d76 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:50.919211 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e3c61207-1a58-4aca-8ce8-861b507b1d76 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:50.919994 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e3c61207-1a58-4aca-8ce8-861b507b1d76 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:50.920451 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e3c61207-1a58-4aca-8ce8-861b507b1d76 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:51.209552 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-94201eea-13c0-43fa-bd87-487f59ad7406 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:51.210530 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-94201eea-13c0-43fa-bd87-487f59ad7406 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:51.218628 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-94201eea-13c0-43fa-bd87-487f59ad7406 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:51.219088 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-94201eea-13c0-43fa-bd87-487f59ad7406 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:51.219961 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-94201eea-13c0-43fa-bd87-487f59ad7406 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:51.220526 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-94201eea-13c0-43fa-bd87-487f59ad7406 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:51.442445 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-94201eea-13c0-43fa-bd87-487f59ad7406 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:51.451898 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-94201eea-13c0-43fa-bd87-487f59ad7406 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0" status: 200 len: 1523 microversion: 2.1 time: 0.245794 May 27 03:42:51.452665 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 152/321] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:42:51 2021] GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0 => generated 1523 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:42:51.866800 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-e3c61207-1a58-4aca-8ce8-861b507b1d76 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "POST /compute/v2.1/servers/6ad4e5b6-865b-4cda-ade3-c3eb357ec57e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.960875 May 27 03:42:51.867848 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 170/322] 10.222.0.25 () {60 vars in 1323 bytes} [Thu May 27 03:42:50 2021] POST /compute/v2.1/servers/6ad4e5b6-865b-4cda-ade3-c3eb357ec57e/os-volume_attachments => generated 194 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:42:51.916580 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-e238e389-81fc-45a7-b450-7a11a2e56f1b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:51.917561 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-e238e389-81fc-45a7-b450-7a11a2e56f1b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:51.925669 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e238e389-81fc-45a7-b450-7a11a2e56f1b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:51.926112 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e238e389-81fc-45a7-b450-7a11a2e56f1b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:51.927026 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e238e389-81fc-45a7-b450-7a11a2e56f1b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:51.927466 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e238e389-81fc-45a7-b450-7a11a2e56f1b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:51.933105 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-42d83750-0f84-4270-9f3d-f5430b97b792 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:51.934424 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-42d83750-0f84-4270-9f3d-f5430b97b792 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:51.951471 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-42d83750-0f84-4270-9f3d-f5430b97b792 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:51.951471 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-42d83750-0f84-4270-9f3d-f5430b97b792 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:51.951471 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-42d83750-0f84-4270-9f3d-f5430b97b792 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:51.951471 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-42d83750-0f84-4270-9f3d-f5430b97b792 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:52.044200 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-e238e389-81fc-45a7-b450-7a11a2e56f1b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 28239 microversion: 2.20 time: 0.131758 May 27 03:42:52.045507 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 153/323] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:42:51 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 28239 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:42:52.086724 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-42d83750-0f84-4270-9f3d-f5430b97b792 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28267 microversion: 2.1 time: 0.160644 May 27 03:42:52.087746 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 171/324] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:42:51 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 03:42:52.471132 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-9640f3b2-701e-4ad0-a8af-bb12d4ffc104 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:52.471827 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-9640f3b2-701e-4ad0-a8af-bb12d4ffc104 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:52.480131 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-9640f3b2-701e-4ad0-a8af-bb12d4ffc104 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:52.480532 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-9640f3b2-701e-4ad0-a8af-bb12d4ffc104 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:52.481533 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-9640f3b2-701e-4ad0-a8af-bb12d4ffc104 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:52.481970 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-9640f3b2-701e-4ad0-a8af-bb12d4ffc104 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:52.682478 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-9640f3b2-701e-4ad0-a8af-bb12d4ffc104 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:52.691399 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-9640f3b2-701e-4ad0-a8af-bb12d4ffc104 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0" status: 200 len: 1523 microversion: 2.1 time: 0.225994 May 27 03:42:52.691957 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 154/325] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:42:52 2021] GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0 => generated 1523 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:53.057372 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-701056f9-5bde-4755-a6be-ee13f7fb5250 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:53.071161 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-701056f9-5bde-4755-a6be-ee13f7fb5250 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:53.071161 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-701056f9-5bde-4755-a6be-ee13f7fb5250 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:53.071161 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-701056f9-5bde-4755-a6be-ee13f7fb5250 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:53.071161 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-701056f9-5bde-4755-a6be-ee13f7fb5250 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:53.071614 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-701056f9-5bde-4755-a6be-ee13f7fb5250 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:53.098817 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-90d517e7-5c18-4074-b381-1d0f2a32f90f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:53.099776 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-90d517e7-5c18-4074-b381-1d0f2a32f90f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:53.110360 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-90d517e7-5c18-4074-b381-1d0f2a32f90f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:53.110952 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-90d517e7-5c18-4074-b381-1d0f2a32f90f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:53.111718 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-90d517e7-5c18-4074-b381-1d0f2a32f90f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:53.112154 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-90d517e7-5c18-4074-b381-1d0f2a32f90f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:53.189954 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-701056f9-5bde-4755-a6be-ee13f7fb5250 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 28239 microversion: 2.20 time: 0.136538 May 27 03:42:53.190604 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 172/326] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:42:53 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 28239 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:42:53.211268 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-90d517e7-5c18-4074-b381-1d0f2a32f90f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28533 microversion: 2.1 time: 0.116110 May 27 03:42:53.212655 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 155/327] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:42:53 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28533 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 03:42:53.710984 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-21ef3685-9c2e-43a4-88b8-2799060b921e tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:53.713046 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-21ef3685-9c2e-43a4-88b8-2799060b921e tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:53.726285 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-21ef3685-9c2e-43a4-88b8-2799060b921e tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:53.726847 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-21ef3685-9c2e-43a4-88b8-2799060b921e tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:53.727769 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-21ef3685-9c2e-43a4-88b8-2799060b921e tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:53.728519 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-21ef3685-9c2e-43a4-88b8-2799060b921e tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:53.946679 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-21ef3685-9c2e-43a4-88b8-2799060b921e tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:53.956112 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-21ef3685-9c2e-43a4-88b8-2799060b921e tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0" status: 200 len: 1523 microversion: 2.1 time: 0.250963 May 27 03:42:53.956841 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 173/328] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:42:53 2021] GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0 => generated 1523 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:54.203830 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-a0bed776-691d-4bf1-83e7-9a5ad4fd7d67 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:54.205047 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-a0bed776-691d-4bf1-83e7-9a5ad4fd7d67 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:54.212941 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a0bed776-691d-4bf1-83e7-9a5ad4fd7d67 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:54.213512 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a0bed776-691d-4bf1-83e7-9a5ad4fd7d67 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:54.214280 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a0bed776-691d-4bf1-83e7-9a5ad4fd7d67 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:54.214716 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a0bed776-691d-4bf1-83e7-9a5ad4fd7d67 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:54.223109 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-d5ec6035-318b-441c-b94b-f0e5f576e7ee tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:54.224081 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-d5ec6035-318b-441c-b94b-f0e5f576e7ee tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:54.231346 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d5ec6035-318b-441c-b94b-f0e5f576e7ee tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:54.231805 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d5ec6035-318b-441c-b94b-f0e5f576e7ee tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:54.232698 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d5ec6035-318b-441c-b94b-f0e5f576e7ee tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:54.233144 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d5ec6035-318b-441c-b94b-f0e5f576e7ee tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:54.396483 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-a0bed776-691d-4bf1-83e7-9a5ad4fd7d67 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 28525 microversion: 2.20 time: 0.197896 May 27 03:42:54.397121 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 156/329] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:42:54 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 28525 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:42:54.402267 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-d5ec6035-318b-441c-b94b-f0e5f576e7ee tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28533 microversion: 2.1 time: 0.182350 May 27 03:42:54.403093 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 174/330] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:42:54 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28533 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 03:42:54.973671 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-4bb14ca5-f43e-4521-8f2a-7497b2b43b33 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:54.974984 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-4bb14ca5-f43e-4521-8f2a-7497b2b43b33 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:54.982766 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-4bb14ca5-f43e-4521-8f2a-7497b2b43b33 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:54.983227 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-4bb14ca5-f43e-4521-8f2a-7497b2b43b33 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:54.984000 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-4bb14ca5-f43e-4521-8f2a-7497b2b43b33 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:54.984467 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-4bb14ca5-f43e-4521-8f2a-7497b2b43b33 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:55.229462 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-4bb14ca5-f43e-4521-8f2a-7497b2b43b33 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:55.241856 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-4bb14ca5-f43e-4521-8f2a-7497b2b43b33 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0" status: 200 len: 1503 microversion: 2.1 time: 0.272074 May 27 03:42:55.242457 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 157/331] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:42:54 2021] GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0 => generated 1503 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:55.259374 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-8f1ae957-2bfb-4cfd-91b6-8692a0d50d91 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "98d22ad9-7ac8-4e99-8a2a-7904a7635410"}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:55.260579 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-8f1ae957-2bfb-4cfd-91b6-8692a0d50d91 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:55.268377 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8f1ae957-2bfb-4cfd-91b6-8692a0d50d91 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:55.274088 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8f1ae957-2bfb-4cfd-91b6-8692a0d50d91 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:55.274088 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8f1ae957-2bfb-4cfd-91b6-8692a0d50d91 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:55.274088 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8f1ae957-2bfb-4cfd-91b6-8692a0d50d91 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:55.327794 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.wsgi [None req-8f1ae957-2bfb-4cfd-91b6-8692a0d50d91 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] HTTP exception thrown: Cannot 'attach_volume' instance 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0 while it is in vm_state rescued May 27 03:42:55.328391 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-8f1ae957-2bfb-4cfd-91b6-8692a0d50d91 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Returning 409 to user: Cannot 'attach_volume' instance 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0 while it is in vm_state rescued {{(pid=113020) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 27 03:42:55.329270 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-8f1ae957-2bfb-4cfd-91b6-8692a0d50d91 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "POST /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.074784 May 27 03:42:55.329820 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 175/332] 10.222.0.25 () {60 vars in 1323 bytes} [Thu May 27 03:42:55 2021] POST /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0/os-volume_attachments => generated 152 bytes in 76 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) May 27 03:42:55.338363 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-aa8d0880-9eb6-4446-9dc1-935f9e87d5b4 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:55.339046 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-aa8d0880-9eb6-4446-9dc1-935f9e87d5b4 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:55.347015 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-aa8d0880-9eb6-4446-9dc1-935f9e87d5b4 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:55.347481 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-aa8d0880-9eb6-4446-9dc1-935f9e87d5b4 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:55.351422 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-aa8d0880-9eb6-4446-9dc1-935f9e87d5b4 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:55.351422 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-aa8d0880-9eb6-4446-9dc1-935f9e87d5b4 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:55.417646 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-00327bcd-93c6-45a3-b99b-95baaac11bcc tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:55.418563 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-00327bcd-93c6-45a3-b99b-95baaac11bcc tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:55.426417 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-00327bcd-93c6-45a3-b99b-95baaac11bcc tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:55.429248 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-00327bcd-93c6-45a3-b99b-95baaac11bcc tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:55.429248 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-00327bcd-93c6-45a3-b99b-95baaac11bcc tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:55.429248 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-00327bcd-93c6-45a3-b99b-95baaac11bcc tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:55.546166 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-00327bcd-93c6-45a3-b99b-95baaac11bcc tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 28525 microversion: 2.20 time: 0.132420 May 27 03:42:55.547183 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 176/333] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:42:55 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 28525 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 27 03:42:55.552315 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-b81a9b35-44ae-4bb1-a01e-71863ff45970 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:55.553280 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-b81a9b35-44ae-4bb1-a01e-71863ff45970 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:55.561181 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b81a9b35-44ae-4bb1-a01e-71863ff45970 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:55.561660 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b81a9b35-44ae-4bb1-a01e-71863ff45970 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:55.562414 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b81a9b35-44ae-4bb1-a01e-71863ff45970 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:55.562853 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b81a9b35-44ae-4bb1-a01e-71863ff45970 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:55.603212 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-aa8d0880-9eb6-4446-9dc1-935f9e87d5b4 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "POST /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0/action" status: 202 len: 0 microversion: 2.1 time: 0.268465 May 27 03:42:55.604039 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 158/334] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:42:55 2021] POST /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:42:55.613073 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-ea299376-5776-48f4-9661-3a0705a1d5d1 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:55.613768 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-ea299376-5776-48f4-9661-3a0705a1d5d1 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:55.622195 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ea299376-5776-48f4-9661-3a0705a1d5d1 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:55.623482 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ea299376-5776-48f4-9661-3a0705a1d5d1 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:55.624265 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ea299376-5776-48f4-9661-3a0705a1d5d1 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:55.625285 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ea299376-5776-48f4-9661-3a0705a1d5d1 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:55.687744 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-b81a9b35-44ae-4bb1-a01e-71863ff45970 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28701 microversion: 2.1 time: 0.138804 May 27 03:42:55.691527 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 177/335] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:42:55 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28701 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:42:55.998593 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-ea299376-5776-48f4-9661-3a0705a1d5d1 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:56.013773 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-ea299376-5776-48f4-9661-3a0705a1d5d1 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0" status: 200 len: 1511 microversion: 2.1 time: 0.404890 May 27 03:42:56.014576 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 159/336] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:42:55 2021] GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0 => generated 1511 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:42:56.558650 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-20c36a39-81e3-4c45-8782-04dac4cc1351 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:56.559666 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-20c36a39-81e3-4c45-8782-04dac4cc1351 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:56.568052 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-20c36a39-81e3-4c45-8782-04dac4cc1351 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:56.568532 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-20c36a39-81e3-4c45-8782-04dac4cc1351 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:56.569308 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-20c36a39-81e3-4c45-8782-04dac4cc1351 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:56.569740 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-20c36a39-81e3-4c45-8782-04dac4cc1351 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:56.699168 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-585b6437-bde6-4350-b0b6-f6603a148178 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:56.700080 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-585b6437-bde6-4350-b0b6-f6603a148178 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:56.707965 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-585b6437-bde6-4350-b0b6-f6603a148178 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:56.708427 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-585b6437-bde6-4350-b0b6-f6603a148178 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:56.709216 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-585b6437-bde6-4350-b0b6-f6603a148178 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:56.709648 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-585b6437-bde6-4350-b0b6-f6603a148178 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:56.721960 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-20c36a39-81e3-4c45-8782-04dac4cc1351 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 28650 microversion: 2.20 time: 0.167539 May 27 03:42:56.723455 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 178/337] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:42:56 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 28650 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:42:56.830482 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-585b6437-bde6-4350-b0b6-f6603a148178 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28701 microversion: 2.1 time: 0.134785 May 27 03:42:56.831131 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 160/338] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:42:56 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28701 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 03:42:57.036524 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-77b3ecf0-dc8d-4056-8bac-d19495f9afb2 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:57.037235 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-77b3ecf0-dc8d-4056-8bac-d19495f9afb2 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:57.045604 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-77b3ecf0-dc8d-4056-8bac-d19495f9afb2 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:57.046063 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-77b3ecf0-dc8d-4056-8bac-d19495f9afb2 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:57.046869 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-77b3ecf0-dc8d-4056-8bac-d19495f9afb2 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:57.047315 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-77b3ecf0-dc8d-4056-8bac-d19495f9afb2 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:57.246900 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-77b3ecf0-dc8d-4056-8bac-d19495f9afb2 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:57.258601 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-77b3ecf0-dc8d-4056-8bac-d19495f9afb2 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0" status: 200 len: 1511 microversion: 2.1 time: 0.226306 May 27 03:42:57.259253 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 179/339] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:42:57 2021] GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0 => generated 1511 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:57.734697 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-f559402c-f1f0-4b89-a0ab-6ce0f1649579 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:57.735732 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-f559402c-f1f0-4b89-a0ab-6ce0f1649579 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:57.744131 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f559402c-f1f0-4b89-a0ab-6ce0f1649579 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:57.744131 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f559402c-f1f0-4b89-a0ab-6ce0f1649579 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:57.744868 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f559402c-f1f0-4b89-a0ab-6ce0f1649579 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:57.745453 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f559402c-f1f0-4b89-a0ab-6ce0f1649579 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:57.842767 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-39ca5ddb-5fe3-45d2-a6a4-0d818845ccc1 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:57.843760 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-39ca5ddb-5fe3-45d2-a6a4-0d818845ccc1 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:57.851274 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-39ca5ddb-5fe3-45d2-a6a4-0d818845ccc1 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:57.851995 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-39ca5ddb-5fe3-45d2-a6a4-0d818845ccc1 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:57.852343 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-f559402c-f1f0-4b89-a0ab-6ce0f1649579 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 28693 microversion: 2.20 time: 0.121731 May 27 03:42:57.856373 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 161/340] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:42:57 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 28693 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:42:57.856772 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-39ca5ddb-5fe3-45d2-a6a4-0d818845ccc1 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:57.858054 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-39ca5ddb-5fe3-45d2-a6a4-0d818845ccc1 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:57.978021 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-39ca5ddb-5fe3-45d2-a6a4-0d818845ccc1 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28701 microversion: 2.1 time: 0.139314 May 27 03:42:57.978899 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 180/341] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:42:57 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28701 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:42:58.277101 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-203d078b-66de-4cf1-83aa-dd380227ce8b tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:58.277835 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-203d078b-66de-4cf1-83aa-dd380227ce8b tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:58.286613 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-203d078b-66de-4cf1-83aa-dd380227ce8b tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:58.287070 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-203d078b-66de-4cf1-83aa-dd380227ce8b tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:58.287852 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-203d078b-66de-4cf1-83aa-dd380227ce8b tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:58.288290 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-203d078b-66de-4cf1-83aa-dd380227ce8b tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:58.492185 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-203d078b-66de-4cf1-83aa-dd380227ce8b tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:58.502448 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-203d078b-66de-4cf1-83aa-dd380227ce8b tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0" status: 200 len: 1511 microversion: 2.1 time: 0.229031 May 27 03:42:58.512297 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 162/342] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:42:58 2021] GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0 => generated 1511 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:42:58.863791 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-a79e845a-77b5-4846-8960-9fc949e43ce6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:58.864854 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-a79e845a-77b5-4846-8960-9fc949e43ce6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:58.873618 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a79e845a-77b5-4846-8960-9fc949e43ce6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:58.874086 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a79e845a-77b5-4846-8960-9fc949e43ce6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:58.875011 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a79e845a-77b5-4846-8960-9fc949e43ce6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:58.875355 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a79e845a-77b5-4846-8960-9fc949e43ce6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:58.989513 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-67ec3209-68f4-438b-a4c4-75bbd0c2e309 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:42:58.990477 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-67ec3209-68f4-438b-a4c4-75bbd0c2e309 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:58.998299 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-67ec3209-68f4-438b-a4c4-75bbd0c2e309 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:58.998757 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-67ec3209-68f4-438b-a4c4-75bbd0c2e309 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:58.999541 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-67ec3209-68f4-438b-a4c4-75bbd0c2e309 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:59.000033 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-67ec3209-68f4-438b-a4c4-75bbd0c2e309 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:59.006501 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-a79e845a-77b5-4846-8960-9fc949e43ce6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 28693 microversion: 2.20 time: 0.146677 May 27 03:42:59.010752 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 181/343] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:42:58 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 28693 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:42:59.364002 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-67ec3209-68f4-438b-a4c4-75bbd0c2e309 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28701 microversion: 2.1 time: 0.377884 May 27 03:42:59.364578 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 163/344] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:42:58 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28701 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:42:59.519893 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-d458e83e-ba89-4b4c-bb13-f6a14e5a74f3 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:42:59.520612 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-d458e83e-ba89-4b4c-bb13-f6a14e5a74f3 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:42:59.528487 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d458e83e-ba89-4b4c-bb13-f6a14e5a74f3 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:59.529591 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d458e83e-ba89-4b4c-bb13-f6a14e5a74f3 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:59.530354 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d458e83e-ba89-4b4c-bb13-f6a14e5a74f3 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:42:59.530791 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d458e83e-ba89-4b4c-bb13-f6a14e5a74f3 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:42:59.752478 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-d458e83e-ba89-4b4c-bb13-f6a14e5a74f3 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:42:59.761171 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-d458e83e-ba89-4b4c-bb13-f6a14e5a74f3 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0" status: 200 len: 1511 microversion: 2.1 time: 0.245352 May 27 03:42:59.761809 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 182/345] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:42:59 2021] GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0 => generated 1511 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:00.019614 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-1f7c5753-3f89-4083-8054-c14487d09970 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:00.020639 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-1f7c5753-3f89-4083-8054-c14487d09970 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:00.028425 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1f7c5753-3f89-4083-8054-c14487d09970 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:00.029452 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1f7c5753-3f89-4083-8054-c14487d09970 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:00.030222 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1f7c5753-3f89-4083-8054-c14487d09970 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:00.030657 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1f7c5753-3f89-4083-8054-c14487d09970 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:00.148387 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-1f7c5753-3f89-4083-8054-c14487d09970 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 28693 microversion: 2.20 time: 0.132725 May 27 03:43:00.149073 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 164/346] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:43:00 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 28693 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:43:00.392022 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-64179aa0-3c1d-4de3-a1d9-dc516599fb05 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:00.393182 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-64179aa0-3c1d-4de3-a1d9-dc516599fb05 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:00.400766 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-64179aa0-3c1d-4de3-a1d9-dc516599fb05 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:00.401221 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-64179aa0-3c1d-4de3-a1d9-dc516599fb05 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:00.402017 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-64179aa0-3c1d-4de3-a1d9-dc516599fb05 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:00.402437 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-64179aa0-3c1d-4de3-a1d9-dc516599fb05 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:00.555437 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-64179aa0-3c1d-4de3-a1d9-dc516599fb05 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28701 microversion: 2.1 time: 0.167553 May 27 03:43:00.556088 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 183/347] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:43:00 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28701 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:43:00.779144 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-d14f5540-abcc-42d2-872c-8e20db990309 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:00.780037 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-d14f5540-abcc-42d2-872c-8e20db990309 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:00.790363 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d14f5540-abcc-42d2-872c-8e20db990309 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:00.790980 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d14f5540-abcc-42d2-872c-8e20db990309 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:00.792251 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d14f5540-abcc-42d2-872c-8e20db990309 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:00.792797 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d14f5540-abcc-42d2-872c-8e20db990309 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:00.884342 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-7b7f1e08-e41c-40f4-9ab5-c0382b8b4c8a tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d79e3521-131c-4fd5-a11c-8d7b4e4da17a"}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:00.885746 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-7b7f1e08-e41c-40f4-9ab5-c0382b8b4c8a tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 6ad4e5b6-865b-4cda-ade3-c3eb357ec57e] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:00.895001 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7b7f1e08-e41c-40f4-9ab5-c0382b8b4c8a tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:00.895461 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7b7f1e08-e41c-40f4-9ab5-c0382b8b4c8a tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:00.896241 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7b7f1e08-e41c-40f4-9ab5-c0382b8b4c8a tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:00.896710 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7b7f1e08-e41c-40f4-9ab5-c0382b8b4c8a tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:01.024847 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-d14f5540-abcc-42d2-872c-8e20db990309 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:01.034079 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-d14f5540-abcc-42d2-872c-8e20db990309 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0" status: 200 len: 1511 microversion: 2.1 time: 0.259669 May 27 03:43:01.034740 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 165/348] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:00 2021] GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0 => generated 1511 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:01.067134 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.wsgi [None req-7b7f1e08-e41c-40f4-9ab5-c0382b8b4c8a tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] HTTP exception thrown: Invalid volume: volume d79e3521-131c-4fd5-a11c-8d7b4e4da17a is already attached to instances: 6ad4e5b6-865b-4cda-ade3-c3eb357ec57e May 27 03:43:01.067707 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-7b7f1e08-e41c-40f4-9ab5-c0382b8b4c8a tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Returning 400 to user: Invalid volume: volume d79e3521-131c-4fd5-a11c-8d7b4e4da17a is already attached to instances: 6ad4e5b6-865b-4cda-ade3-c3eb357ec57e {{(pid=113020) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 27 03:43:01.068578 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-7b7f1e08-e41c-40f4-9ab5-c0382b8b4c8a tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "POST /compute/v2.1/servers/6ad4e5b6-865b-4cda-ade3-c3eb357ec57e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.188436 May 27 03:43:01.069137 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 184/349] 10.222.0.25 () {60 vars in 1323 bytes} [Thu May 27 03:43:00 2021] POST /compute/v2.1/servers/6ad4e5b6-865b-4cda-ade3-c3eb357ec57e/os-volume_attachments => generated 174 bytes in 190 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 03:43:01.160987 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-61bf4ada-4167-46f0-80f5-c6044aaa741f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:01.162041 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-61bf4ada-4167-46f0-80f5-c6044aaa741f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:01.170362 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-61bf4ada-4167-46f0-80f5-c6044aaa741f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:01.171052 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-61bf4ada-4167-46f0-80f5-c6044aaa741f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:01.174302 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-61bf4ada-4167-46f0-80f5-c6044aaa741f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:01.174302 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-61bf4ada-4167-46f0-80f5-c6044aaa741f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:01.240280 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-3175a1ca-1bbf-41fd-ab16-3f276d7aa96d tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:01.240813 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-3175a1ca-1bbf-41fd-ab16-3f276d7aa96d tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 6ad4e5b6-865b-4cda-ade3-c3eb357ec57e] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:01.248193 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3175a1ca-1bbf-41fd-ab16-3f276d7aa96d tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:01.248768 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3175a1ca-1bbf-41fd-ab16-3f276d7aa96d tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:01.249555 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3175a1ca-1bbf-41fd-ab16-3f276d7aa96d tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:01.249994 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3175a1ca-1bbf-41fd-ab16-3f276d7aa96d tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:01.305585 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-61bf4ada-4167-46f0-80f5-c6044aaa741f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 28693 microversion: 2.20 time: 0.148249 May 27 03:43:01.306408 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 166/350] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:43:01 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 28693 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:43:01.412054 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.objects.instance [None req-3175a1ca-1bbf-41fd-ab16-3f276d7aa96d tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lazy-loading 'services' on Instance uuid 6ad4e5b6-865b-4cda-ade3-c3eb357ec57e {{(pid=113020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 27 03:43:01.567793 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-c63b4c1d-332c-4cd9-bd5f-fade44702d0b tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:01.568920 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-c63b4c1d-332c-4cd9-bd5f-fade44702d0b tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:01.577331 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c63b4c1d-332c-4cd9-bd5f-fade44702d0b tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:01.577724 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c63b4c1d-332c-4cd9-bd5f-fade44702d0b tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:01.578523 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c63b4c1d-332c-4cd9-bd5f-fade44702d0b tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:01.578981 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c63b4c1d-332c-4cd9-bd5f-fade44702d0b tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:01.655178 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-3175a1ca-1bbf-41fd-ab16-3f276d7aa96d tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6ad4e5b6-865b-4cda-ade3-c3eb357ec57e/os-volume_attachments/d79e3521-131c-4fd5-a11c-8d7b4e4da17a" status: 202 len: 0 microversion: 2.1 time: 0.418390 May 27 03:43:01.655766 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 185/351] 10.222.0.25 () {58 vars in 1416 bytes} [Thu May 27 03:43:01 2021] DELETE /compute/v2.1/servers/6ad4e5b6-865b-4cda-ade3-c3eb357ec57e/os-volume_attachments/d79e3521-131c-4fd5-a11c-8d7b4e4da17a => generated 0 bytes in 420 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:43:01.684900 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-c63b4c1d-332c-4cd9-bd5f-fade44702d0b tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28701 microversion: 2.1 time: 0.121046 May 27 03:43:01.687373 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 167/352] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:43:01 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28701 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 03:43:02.052191 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-6a212ede-3360-4180-adc5-72d1783dff94 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:02.052944 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-6a212ede-3360-4180-adc5-72d1783dff94 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:02.061764 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6a212ede-3360-4180-adc5-72d1783dff94 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:02.062231 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6a212ede-3360-4180-adc5-72d1783dff94 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:02.063020 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6a212ede-3360-4180-adc5-72d1783dff94 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:02.063463 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6a212ede-3360-4180-adc5-72d1783dff94 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:02.270249 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-6a212ede-3360-4180-adc5-72d1783dff94 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:02.278417 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-6a212ede-3360-4180-adc5-72d1783dff94 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0" status: 200 len: 1517 microversion: 2.1 time: 0.230851 May 27 03:43:02.279034 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 186/353] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:02 2021] GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0 => generated 1517 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:02.318235 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-8cd24160-187b-41ab-a2f4-e1576e28c6a8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:02.319378 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-8cd24160-187b-41ab-a2f4-e1576e28c6a8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:02.334167 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8cd24160-187b-41ab-a2f4-e1576e28c6a8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:02.334699 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8cd24160-187b-41ab-a2f4-e1576e28c6a8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:02.335732 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8cd24160-187b-41ab-a2f4-e1576e28c6a8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:02.336652 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8cd24160-187b-41ab-a2f4-e1576e28c6a8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:02.441718 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-8cd24160-187b-41ab-a2f4-e1576e28c6a8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 28693 microversion: 2.20 time: 0.127426 May 27 03:43:02.445079 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 168/354] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:43:02 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 28693 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:43:02.702693 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-f9bd0232-92c8-486d-8376-a8e7fd6caf40 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:02.703671 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-f9bd0232-92c8-486d-8376-a8e7fd6caf40 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:02.711059 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f9bd0232-92c8-486d-8376-a8e7fd6caf40 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:02.711508 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f9bd0232-92c8-486d-8376-a8e7fd6caf40 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:02.712380 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f9bd0232-92c8-486d-8376-a8e7fd6caf40 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:02.712842 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f9bd0232-92c8-486d-8376-a8e7fd6caf40 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:02.830203 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-f9bd0232-92c8-486d-8376-a8e7fd6caf40 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28701 microversion: 2.1 time: 0.131452 May 27 03:43:02.830870 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 187/355] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:43:02 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28701 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:43:03.209466 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-e4b4d856-ee55-4db3-bdde-7b481fa2d1bc tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-645029303", "imageRef": "78c0913d-0e41-4b41-b38f-f45c4f2535ff", "flavorRef": "452", "networks": [{"uuid": "9d88eb5c-a234-4a0b-9721-bcab674f53e1"}]}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:03.455430 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-b3e6ae95-b402-4d40-96c6-11fe72148c10 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:03.456472 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-b3e6ae95-b402-4d40-96c6-11fe72148c10 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:03.464761 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b3e6ae95-b402-4d40-96c6-11fe72148c10 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:03.465270 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b3e6ae95-b402-4d40-96c6-11fe72148c10 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:03.471552 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b3e6ae95-b402-4d40-96c6-11fe72148c10 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:03.471552 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b3e6ae95-b402-4d40-96c6-11fe72148c10 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:03.599432 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-b3e6ae95-b402-4d40-96c6-11fe72148c10 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 28693 microversion: 2.20 time: 0.148538 May 27 03:43:03.603405 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 188/356] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:43:03 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 28693 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 27 03:43:03.842963 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-f0d6f121-a3d3-4700-aa28-c3f0fbe3f090 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:03.844035 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-f0d6f121-a3d3-4700-aa28-c3f0fbe3f090 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:03.852112 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f0d6f121-a3d3-4700-aa28-c3f0fbe3f090 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:03.852609 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f0d6f121-a3d3-4700-aa28-c3f0fbe3f090 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:03.853396 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f0d6f121-a3d3-4700-aa28-c3f0fbe3f090 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:03.853872 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f0d6f121-a3d3-4700-aa28-c3f0fbe3f090 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:03.977808 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-f0d6f121-a3d3-4700-aa28-c3f0fbe3f090 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28701 microversion: 2.1 time: 0.139394 May 27 03:43:03.978441 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 189/357] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:43:03 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28701 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:43:04.611752 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-08785716-f3e7-4016-bae1-077492c66cc6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:04.612879 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-08785716-f3e7-4016-bae1-077492c66cc6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:04.622509 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-08785716-f3e7-4016-bae1-077492c66cc6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:04.625155 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-08785716-f3e7-4016-bae1-077492c66cc6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:04.625155 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-08785716-f3e7-4016-bae1-077492c66cc6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:04.625155 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-08785716-f3e7-4016-bae1-077492c66cc6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:04.734873 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-08785716-f3e7-4016-bae1-077492c66cc6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 28693 microversion: 2.20 time: 0.127067 May 27 03:43:04.735734 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 190/358] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:43:04 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 28693 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 27 03:43:04.990552 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-c564640d-c2e8-4870-9ecf-6ac39b2254a7 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:04.991555 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-c564640d-c2e8-4870-9ecf-6ac39b2254a7 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:04.999312 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c564640d-c2e8-4870-9ecf-6ac39b2254a7 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:04.999760 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c564640d-c2e8-4870-9ecf-6ac39b2254a7 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:05.000594 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c564640d-c2e8-4870-9ecf-6ac39b2254a7 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:05.001525 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c564640d-c2e8-4870-9ecf-6ac39b2254a7 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:05.103502 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-c564640d-c2e8-4870-9ecf-6ac39b2254a7 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28701 microversion: 2.1 time: 0.116875 May 27 03:43:05.104134 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 191/359] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:43:04 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28701 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 03:43:05.348284 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-bc6559ee-0471-4ed8-847c-f33efcdb312a tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:05.349012 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-bc6559ee-0471-4ed8-847c-f33efcdb312a tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:05.356782 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-bc6559ee-0471-4ed8-847c-f33efcdb312a tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:05.357231 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-bc6559ee-0471-4ed8-847c-f33efcdb312a tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:05.357989 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-bc6559ee-0471-4ed8-847c-f33efcdb312a tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:05.358421 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-bc6559ee-0471-4ed8-847c-f33efcdb312a tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:05.560149 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-bc6559ee-0471-4ed8-847c-f33efcdb312a tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:05.568441 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-bc6559ee-0471-4ed8-847c-f33efcdb312a tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0" status: 200 len: 1517 microversion: 2.1 time: 0.224668 May 27 03:43:05.569013 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 192/360] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:05 2021] GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0 => generated 1517 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:43:05.584447 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-d42a1e91-0ac2-415d-a63c-bad029460b07 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "164e4da2-e84c-4cac-9094-bb0cf941dd13"}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:05.585583 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-d42a1e91-0ac2-415d-a63c-bad029460b07 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:05.592705 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d42a1e91-0ac2-415d-a63c-bad029460b07 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:05.593163 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d42a1e91-0ac2-415d-a63c-bad029460b07 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:05.594229 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d42a1e91-0ac2-415d-a63c-bad029460b07 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:05.594676 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d42a1e91-0ac2-415d-a63c-bad029460b07 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:06.499398 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-d42a1e91-0ac2-415d-a63c-bad029460b07 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "POST /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.918745 May 27 03:43:06.500123 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 193/361] 10.222.0.25 () {60 vars in 1323 bytes} [Thu May 27 03:43:05 2021] POST /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0/os-volume_attachments => generated 194 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:43:06.510376 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-f9c628ff-bd2c-4603-8426-8790f39123a4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:06.511449 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-f9c628ff-bd2c-4603-8426-8790f39123a4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:06.519748 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f9c628ff-bd2c-4603-8426-8790f39123a4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:06.520295 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f9c628ff-bd2c-4603-8426-8790f39123a4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:06.521149 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f9c628ff-bd2c-4603-8426-8790f39123a4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:06.521654 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f9c628ff-bd2c-4603-8426-8790f39123a4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:06.666488 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-f9c628ff-bd2c-4603-8426-8790f39123a4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 28693 microversion: 2.20 time: 0.160085 May 27 03:43:06.667996 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 194/362] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:43:06 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 28693 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:43:06.672511 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-dc464c8a-75b2-4909-9f8c-e6fc91601194 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:06.674041 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-dc464c8a-75b2-4909-9f8c-e6fc91601194 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:06.682072 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-dc464c8a-75b2-4909-9f8c-e6fc91601194 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:06.682522 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-dc464c8a-75b2-4909-9f8c-e6fc91601194 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:06.683307 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-dc464c8a-75b2-4909-9f8c-e6fc91601194 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:06.683751 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-dc464c8a-75b2-4909-9f8c-e6fc91601194 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:06.806843 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-dc464c8a-75b2-4909-9f8c-e6fc91601194 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28701 microversion: 2.1 time: 0.138055 May 27 03:43:06.807483 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 195/363] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:43:06 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28701 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:43:07.679495 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-4b9b2924-7ec6-49f9-9dd6-d78a10267127 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:07.680772 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-4b9b2924-7ec6-49f9-9dd6-d78a10267127 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:07.691699 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4b9b2924-7ec6-49f9-9dd6-d78a10267127 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:07.692364 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4b9b2924-7ec6-49f9-9dd6-d78a10267127 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:07.693567 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4b9b2924-7ec6-49f9-9dd6-d78a10267127 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:07.694182 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4b9b2924-7ec6-49f9-9dd6-d78a10267127 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:07.823153 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-4b9b2924-7ec6-49f9-9dd6-d78a10267127 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 28693 microversion: 2.20 time: 0.147794 May 27 03:43:07.827742 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 196/364] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:43:07 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 28693 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 27 03:43:07.832103 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-a53f8116-fd34-4a37-a70c-365a8498577e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:07.833179 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-a53f8116-fd34-4a37-a70c-365a8498577e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:07.840823 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a53f8116-fd34-4a37-a70c-365a8498577e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:07.841282 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a53f8116-fd34-4a37-a70c-365a8498577e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:07.842060 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a53f8116-fd34-4a37-a70c-365a8498577e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:07.842561 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a53f8116-fd34-4a37-a70c-365a8498577e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:07.940780 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-a53f8116-fd34-4a37-a70c-365a8498577e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28701 microversion: 2.1 time: 0.115522 May 27 03:43:07.942667 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 197/365] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:43:07 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28701 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:43:08.836363 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-56b8d993-42c3-4f56-9cc1-06e50d18f2f2 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:08.837424 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-56b8d993-42c3-4f56-9cc1-06e50d18f2f2 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:08.846527 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-56b8d993-42c3-4f56-9cc1-06e50d18f2f2 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:08.847068 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-56b8d993-42c3-4f56-9cc1-06e50d18f2f2 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:08.848054 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-56b8d993-42c3-4f56-9cc1-06e50d18f2f2 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:08.848522 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-56b8d993-42c3-4f56-9cc1-06e50d18f2f2 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:08.956922 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-56b8d993-42c3-4f56-9cc1-06e50d18f2f2 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 28693 microversion: 2.20 time: 0.124512 May 27 03:43:08.958270 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 198/366] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:43:08 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 28693 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:43:08.963750 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-6a57ddea-1140-451b-b253-aa2aecea1296 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:08.964859 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-6a57ddea-1140-451b-b253-aa2aecea1296 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:08.973549 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6a57ddea-1140-451b-b253-aa2aecea1296 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:08.974006 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6a57ddea-1140-451b-b253-aa2aecea1296 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:08.974792 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6a57ddea-1140-451b-b253-aa2aecea1296 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:08.975235 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6a57ddea-1140-451b-b253-aa2aecea1296 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:09.096282 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-6a57ddea-1140-451b-b253-aa2aecea1296 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28701 microversion: 2.1 time: 0.136249 May 27 03:43:09.097788 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 199/367] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:43:08 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28701 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:43:09.969787 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-f9cb3800-0b3b-452f-b00c-d3bf9be10d2d tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:09.971351 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-f9cb3800-0b3b-452f-b00c-d3bf9be10d2d tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:09.979467 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f9cb3800-0b3b-452f-b00c-d3bf9be10d2d tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:09.979997 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f9cb3800-0b3b-452f-b00c-d3bf9be10d2d tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:09.980876 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f9cb3800-0b3b-452f-b00c-d3bf9be10d2d tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:09.981346 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f9cb3800-0b3b-452f-b00c-d3bf9be10d2d tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:10.082220 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-f9cb3800-0b3b-452f-b00c-d3bf9be10d2d tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 28693 microversion: 2.20 time: 0.116326 May 27 03:43:10.083262 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 200/368] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:43:09 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 28693 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 27 03:43:10.107745 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-2fb242f6-f817-4432-a1a6-9b73bf87c890 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:10.108759 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-2fb242f6-f817-4432-a1a6-9b73bf87c890 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:10.117324 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-2fb242f6-f817-4432-a1a6-9b73bf87c890 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:10.117782 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-2fb242f6-f817-4432-a1a6-9b73bf87c890 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:10.122109 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-2fb242f6-f817-4432-a1a6-9b73bf87c890 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:10.122109 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-2fb242f6-f817-4432-a1a6-9b73bf87c890 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:10.246276 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-2fb242f6-f817-4432-a1a6-9b73bf87c890 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28701 microversion: 2.1 time: 0.142487 May 27 03:43:10.247229 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 201/369] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:43:10 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28701 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 03:43:11.099053 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-bf3c5492-f96c-4cad-92e6-5194421b791e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:11.100419 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-bf3c5492-f96c-4cad-92e6-5194421b791e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:11.104898 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.network.neutron [None req-e4b4d856-ee55-4db3-bdde-7b481fa2d1bc tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] validate_networks() for [('9d88eb5c-a234-4a0b-9721-bcab674f53e1', None, None, None)] {{(pid=113021) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 27 03:43:11.108220 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-bf3c5492-f96c-4cad-92e6-5194421b791e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:11.108718 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-bf3c5492-f96c-4cad-92e6-5194421b791e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:11.109503 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-bf3c5492-f96c-4cad-92e6-5194421b791e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:11.109945 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-bf3c5492-f96c-4cad-92e6-5194421b791e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:11.268980 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-bf3c5492-f96c-4cad-92e6-5194421b791e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 28693 microversion: 2.20 time: 0.178866 May 27 03:43:11.274448 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 202/370] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:43:11 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 28693 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 27 03:43:11.279446 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-01a476f9-0281-4016-9f46-d119f032d817 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:11.280628 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-01a476f9-0281-4016-9f46-d119f032d817 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:11.289800 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-01a476f9-0281-4016-9f46-d119f032d817 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:11.290096 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-01a476f9-0281-4016-9f46-d119f032d817 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:11.291124 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-01a476f9-0281-4016-9f46-d119f032d817 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:11.291540 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-01a476f9-0281-4016-9f46-d119f032d817 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:11.389800 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-01a476f9-0281-4016-9f46-d119f032d817 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28701 microversion: 2.1 time: 0.115065 May 27 03:43:11.391656 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 203/371] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:43:11 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28701 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:43:11.742685 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.virt.hardware [None req-e4b4d856-ee55-4db3-bdde-7b481fa2d1bc tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Flavor limits 0:0:0 {{(pid=113021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 27 03:43:11.743119 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.virt.hardware [None req-e4b4d856-ee55-4db3-bdde-7b481fa2d1bc tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Image limits 0:0:0 {{(pid=113021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 27 03:43:11.743601 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.virt.hardware [None req-e4b4d856-ee55-4db3-bdde-7b481fa2d1bc tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Flavor pref 0:0:0 {{(pid=113021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 27 03:43:11.744016 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.virt.hardware [None req-e4b4d856-ee55-4db3-bdde-7b481fa2d1bc tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Image pref 0:0:0 {{(pid=113021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 27 03:43:11.744487 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.virt.hardware [None req-e4b4d856-ee55-4db3-bdde-7b481fa2d1bc tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=113021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 27 03:43:11.752803 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e4b4d856-ee55-4db3-bdde-7b481fa2d1bc tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:11.753272 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e4b4d856-ee55-4db3-bdde-7b481fa2d1bc tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:11.754094 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e4b4d856-ee55-4db3-bdde-7b481fa2d1bc tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:11.754535 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e4b4d856-ee55-4db3-bdde-7b481fa2d1bc tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:11.771747 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.quota [None req-e4b4d856-ee55-4db3-bdde-7b481fa2d1bc tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Getting quotas for project 7413f58ffa8e476fb5600cbc51ee9d34. Resources: {'instances', 'cores', 'ram'} {{(pid=113021) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 27 03:43:11.775674 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.quota [None req-e4b4d856-ee55-4db3-bdde-7b481fa2d1bc tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Getting quotas for user 925b5b18987f4e1eac67fda030a1714a and project 7413f58ffa8e476fb5600cbc51ee9d34. Resources: {'instances', 'cores', 'ram'} {{(pid=113021) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 27 03:43:11.786917 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-e4b4d856-ee55-4db3-bdde-7b481fa2d1bc tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Going to run 1 instances... {{(pid=113021) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 27 03:43:11.789340 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-e4b4d856-ee55-4db3-bdde-7b481fa2d1bc tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 7caeff19-8b2a-4c81-b6f2-1178b3f1a561] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78c0913d-0e41-4b41-b38f-f45c4f2535ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=113021) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 27 03:43:11.910370 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-e4b4d856-ee55-4db3-bdde-7b481fa2d1bc tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 8.705126 May 27 03:43:11.916073 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 169/372] 10.222.0.25 () {60 vars in 1147 bytes} [Thu May 27 03:43:03 2021] POST /compute/v2.1/servers => generated 380 bytes in 8707 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 03:43:11.921797 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-54ff3938-59db-4c75-adc4-a18ef73c507b tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:11.922555 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-54ff3938-59db-4c75-adc4-a18ef73c507b tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 7caeff19-8b2a-4c81-b6f2-1178b3f1a561] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:12.011420 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-54ff3938-59db-4c75-adc4-a18ef73c507b tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:12.024055 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-54ff3938-59db-4c75-adc4-a18ef73c507b tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/7caeff19-8b2a-4c81-b6f2-1178b3f1a561" status: 200 len: 1217 microversion: 2.1 time: 0.105597 May 27 03:43:12.025215 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 204/373] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:11 2021] GET /compute/v2.1/servers/7caeff19-8b2a-4c81-b6f2-1178b3f1a561 => generated 1217 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:12.281914 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-bbc23cab-e047-4b7c-b5d1-bdef3b0db5a9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:12.283502 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-bbc23cab-e047-4b7c-b5d1-bdef3b0db5a9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:12.291280 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-bbc23cab-e047-4b7c-b5d1-bdef3b0db5a9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:12.291734 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-bbc23cab-e047-4b7c-b5d1-bdef3b0db5a9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:12.292651 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-bbc23cab-e047-4b7c-b5d1-bdef3b0db5a9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:12.292982 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-bbc23cab-e047-4b7c-b5d1-bdef3b0db5a9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:12.400993 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-bbc23cab-e047-4b7c-b5d1-bdef3b0db5a9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 28693 microversion: 2.20 time: 0.122550 May 27 03:43:12.401317 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-321301c9-95d1-471a-91da-9060f3e0b537 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:12.402283 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-321301c9-95d1-471a-91da-9060f3e0b537 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:12.405365 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 170/374] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:43:12 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 28693 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:43:12.411932 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-321301c9-95d1-471a-91da-9060f3e0b537 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:12.412390 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-321301c9-95d1-471a-91da-9060f3e0b537 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:12.413204 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-321301c9-95d1-471a-91da-9060f3e0b537 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:12.413648 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-321301c9-95d1-471a-91da-9060f3e0b537 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:12.522332 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-321301c9-95d1-471a-91da-9060f3e0b537 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28701 microversion: 2.1 time: 0.122718 May 27 03:43:12.522332 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 205/375] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:43:12 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28701 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 03:43:12.711892 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-7735576e-487d-4941-85bd-ebf7abbd3f3e tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-69666135", "imageRef": "78c0913d-0e41-4b41-b38f-f45c4f2535ff", "flavorRef": "452"}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:12.779423 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.network.neutron [None req-7735576e-487d-4941-85bd-ebf7abbd3f3e tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] validate_networks() for None {{(pid=113021) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 27 03:43:13.044674 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-912449ff-4275-45f0-9f8c-3e0d8a7005e1 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:13.046001 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-912449ff-4275-45f0-9f8c-3e0d8a7005e1 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 7caeff19-8b2a-4c81-b6f2-1178b3f1a561] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:13.059396 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-912449ff-4275-45f0-9f8c-3e0d8a7005e1 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:13.059928 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-912449ff-4275-45f0-9f8c-3e0d8a7005e1 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:13.061150 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-912449ff-4275-45f0-9f8c-3e0d8a7005e1 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:13.061590 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-912449ff-4275-45f0-9f8c-3e0d8a7005e1 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:13.197702 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-912449ff-4275-45f0-9f8c-3e0d8a7005e1 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:13.206270 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-912449ff-4275-45f0-9f8c-3e0d8a7005e1 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/7caeff19-8b2a-4c81-b6f2-1178b3f1a561" status: 200 len: 1221 microversion: 2.1 time: 0.168401 May 27 03:43:13.215498 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 206/376] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:13 2021] GET /compute/v2.1/servers/7caeff19-8b2a-4c81-b6f2-1178b3f1a561 => generated 1221 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:13.319984 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.virt.hardware [None req-7735576e-487d-4941-85bd-ebf7abbd3f3e tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Flavor limits 0:0:0 {{(pid=113021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 27 03:43:13.320672 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.virt.hardware [None req-7735576e-487d-4941-85bd-ebf7abbd3f3e tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Image limits 0:0:0 {{(pid=113021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 27 03:43:13.320940 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.virt.hardware [None req-7735576e-487d-4941-85bd-ebf7abbd3f3e tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Flavor pref 0:0:0 {{(pid=113021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 27 03:43:13.321378 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.virt.hardware [None req-7735576e-487d-4941-85bd-ebf7abbd3f3e tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Image pref 0:0:0 {{(pid=113021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 27 03:43:13.322017 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.virt.hardware [None req-7735576e-487d-4941-85bd-ebf7abbd3f3e tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=113021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 27 03:43:13.342171 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-7735576e-487d-4941-85bd-ebf7abbd3f3e tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:13.343051 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-7735576e-487d-4941-85bd-ebf7abbd3f3e tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:13.344734 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-7735576e-487d-4941-85bd-ebf7abbd3f3e tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:13.345765 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-7735576e-487d-4941-85bd-ebf7abbd3f3e tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:13.388877 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.quota [None req-7735576e-487d-4941-85bd-ebf7abbd3f3e tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Getting quotas for project 1fd883d8bafd4e248467bbb7b0feb0c9. Resources: {'instances', 'cores', 'ram'} {{(pid=113021) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 27 03:43:13.394108 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.quota [None req-7735576e-487d-4941-85bd-ebf7abbd3f3e tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Getting quotas for user 95e96f6ace4b43c4b1ef8d989a67ef90 and project 1fd883d8bafd4e248467bbb7b0feb0c9. Resources: {'instances', 'cores', 'ram'} {{(pid=113021) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 27 03:43:13.405579 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-7735576e-487d-4941-85bd-ebf7abbd3f3e tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Going to run 1 instances... {{(pid=113021) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 27 03:43:13.408050 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-7735576e-487d-4941-85bd-ebf7abbd3f3e tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] [instance: fe309d4b-1169-4574-a57b-7e3c2cc5ddf4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78c0913d-0e41-4b41-b38f-f45c4f2535ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=113021) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 27 03:43:13.412989 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-9031c435-d5b3-4722-9667-d09f251bf202 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:13.414156 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-9031c435-d5b3-4722-9667-d09f251bf202 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:13.422259 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9031c435-d5b3-4722-9667-d09f251bf202 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:13.422785 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9031c435-d5b3-4722-9667-d09f251bf202 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:13.424289 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9031c435-d5b3-4722-9667-d09f251bf202 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:13.424814 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9031c435-d5b3-4722-9667-d09f251bf202 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:13.508439 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-7735576e-487d-4941-85bd-ebf7abbd3f3e tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.800593 May 27 03:43:13.509103 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 171/377] 10.222.0.25 () {60 vars in 1147 bytes} [Thu May 27 03:43:12 2021] POST /compute/v2.1/servers => generated 380 bytes in 802 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 03:43:13.518587 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-bdb3e82b-6542-4eb9-86b5-0c4effb5f6ef tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:13.519522 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-bdb3e82b-6542-4eb9-86b5-0c4effb5f6ef tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] [instance: fe309d4b-1169-4574-a57b-7e3c2cc5ddf4] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:13.591198 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-bdb3e82b-6542-4eb9-86b5-0c4effb5f6ef tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e96f6ace4b43c4b1ef8d989a67ef90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fd883d8bafd4e248467bbb7b0feb0c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:13.599696 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-bdb3e82b-6542-4eb9-86b5-0c4effb5f6ef tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] 10.222.0.25 "GET /compute/v2.1/servers/fe309d4b-1169-4574-a57b-7e3c2cc5ddf4" status: 200 len: 1213 microversion: 2.1 time: 0.084778 May 27 03:43:13.600260 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 172/378] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:13 2021] GET /compute/v2.1/servers/fe309d4b-1169-4574-a57b-7e3c2cc5ddf4 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:43:13.609360 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-a341282e-5e20-4f84-aeed-658047e66b3a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:13.610365 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-a341282e-5e20-4f84-aeed-658047e66b3a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:13.618406 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a341282e-5e20-4f84-aeed-658047e66b3a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:13.618853 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a341282e-5e20-4f84-aeed-658047e66b3a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:13.619625 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a341282e-5e20-4f84-aeed-658047e66b3a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:13.620065 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a341282e-5e20-4f84-aeed-658047e66b3a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:13.696848 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-9031c435-d5b3-4722-9667-d09f251bf202 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 28693 microversion: 2.20 time: 0.287247 May 27 03:43:13.697493 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 207/379] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:43:13 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 28693 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 27 03:43:13.734568 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-a341282e-5e20-4f84-aeed-658047e66b3a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28701 microversion: 2.1 time: 0.128729 May 27 03:43:13.735378 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 173/380] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:43:13 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28701 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:43:14.225516 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-d035a86b-bdc7-4108-a544-a6fb92e52671 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:14.226499 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-d035a86b-bdc7-4108-a544-a6fb92e52671 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 7caeff19-8b2a-4c81-b6f2-1178b3f1a561] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:14.235177 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d035a86b-bdc7-4108-a544-a6fb92e52671 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:14.235920 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d035a86b-bdc7-4108-a544-a6fb92e52671 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:14.237049 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d035a86b-bdc7-4108-a544-a6fb92e52671 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:14.237493 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d035a86b-bdc7-4108-a544-a6fb92e52671 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:14.384886 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-d035a86b-bdc7-4108-a544-a6fb92e52671 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:14.397570 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-d035a86b-bdc7-4108-a544-a6fb92e52671 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/7caeff19-8b2a-4c81-b6f2-1178b3f1a561" status: 200 len: 1277 microversion: 2.1 time: 0.177722 May 27 03:43:14.400166 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 208/381] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:14 2021] GET /compute/v2.1/servers/7caeff19-8b2a-4c81-b6f2-1178b3f1a561 => generated 1277 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:14.617391 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-ffce99c7-2df9-45f7-b4ca-d47eb703a8d6 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:14.618103 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-ffce99c7-2df9-45f7-b4ca-d47eb703a8d6 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] [instance: fe309d4b-1169-4574-a57b-7e3c2cc5ddf4] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:14.712718 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-e8341184-05ba-4886-acbb-1eacb71c2683 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:14.714444 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-e8341184-05ba-4886-acbb-1eacb71c2683 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:14.723532 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e8341184-05ba-4886-acbb-1eacb71c2683 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:14.724075 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e8341184-05ba-4886-acbb-1eacb71c2683 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:14.725219 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e8341184-05ba-4886-acbb-1eacb71c2683 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:14.725728 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e8341184-05ba-4886-acbb-1eacb71c2683 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:14.782775 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-ffce99c7-2df9-45f7-b4ca-d47eb703a8d6 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e96f6ace4b43c4b1ef8d989a67ef90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fd883d8bafd4e248467bbb7b0feb0c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:14.792589 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-ffce99c7-2df9-45f7-b4ca-d47eb703a8d6 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] 10.222.0.25 "GET /compute/v2.1/servers/fe309d4b-1169-4574-a57b-7e3c2cc5ddf4" status: 200 len: 1213 microversion: 2.1 time: 0.179254 May 27 03:43:14.802120 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 174/382] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:14 2021] GET /compute/v2.1/servers/fe309d4b-1169-4574-a57b-7e3c2cc5ddf4 => generated 1213 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:14.802120 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-389fffa1-3c2c-407f-aa5e-76d8e31343ad tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:14.802120 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-389fffa1-3c2c-407f-aa5e-76d8e31343ad tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:14.808215 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-389fffa1-3c2c-407f-aa5e-76d8e31343ad tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:14.808704 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-389fffa1-3c2c-407f-aa5e-76d8e31343ad tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:14.809491 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-389fffa1-3c2c-407f-aa5e-76d8e31343ad tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:14.809936 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-389fffa1-3c2c-407f-aa5e-76d8e31343ad tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:14.838651 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-e8341184-05ba-4886-acbb-1eacb71c2683 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 28693 microversion: 2.20 time: 0.131385 May 27 03:43:14.839892 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 209/383] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:43:14 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 28693 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:43:15.040523 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-389fffa1-3c2c-407f-aa5e-76d8e31343ad tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28701 microversion: 2.1 time: 0.245505 May 27 03:43:15.041428 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 175/384] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:43:14 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28701 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:43:15.416653 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-7a84515e-7571-4abf-87b7-dddeb1898a7c tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:15.417369 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-7a84515e-7571-4abf-87b7-dddeb1898a7c tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 7caeff19-8b2a-4c81-b6f2-1178b3f1a561] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:15.436591 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7a84515e-7571-4abf-87b7-dddeb1898a7c tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:15.437180 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7a84515e-7571-4abf-87b7-dddeb1898a7c tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:15.438721 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7a84515e-7571-4abf-87b7-dddeb1898a7c tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:15.439177 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7a84515e-7571-4abf-87b7-dddeb1898a7c tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:15.485247 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-39dddf94-28f5-49d0-b37e-3411fe35f33b tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:15.486566 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-39dddf94-28f5-49d0-b37e-3411fe35f33b tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:15.496014 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-39dddf94-28f5-49d0-b37e-3411fe35f33b tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:15.496484 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-39dddf94-28f5-49d0-b37e-3411fe35f33b tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:15.497642 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-39dddf94-28f5-49d0-b37e-3411fe35f33b tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:15.498277 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-39dddf94-28f5-49d0-b37e-3411fe35f33b tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:15.568518 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.objects.instance [None req-39dddf94-28f5-49d0-b37e-3411fe35f33b tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lazy-loading 'flavor' on Instance uuid 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0 {{(pid=113021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 27 03:43:15.799169 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-7a84515e-7571-4abf-87b7-dddeb1898a7c tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:15.809038 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-7a84515e-7571-4abf-87b7-dddeb1898a7c tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/7caeff19-8b2a-4c81-b6f2-1178b3f1a561" status: 200 len: 1317 microversion: 2.1 time: 0.396673 May 27 03:43:15.815183 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 210/385] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:15 2021] GET /compute/v2.1/servers/7caeff19-8b2a-4c81-b6f2-1178b3f1a561 => generated 1317 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:15.824081 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-601a10d5-77d1-460f-8faa-e2c4ba4129b1 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:15.825034 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-601a10d5-77d1-460f-8faa-e2c4ba4129b1 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] [instance: fe309d4b-1169-4574-a57b-7e3c2cc5ddf4] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:15.833351 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-601a10d5-77d1-460f-8faa-e2c4ba4129b1 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:15.833790 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-601a10d5-77d1-460f-8faa-e2c4ba4129b1 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:15.834558 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-601a10d5-77d1-460f-8faa-e2c4ba4129b1 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:15.834989 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-601a10d5-77d1-460f-8faa-e2c4ba4129b1 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:15.951111 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-601a10d5-77d1-460f-8faa-e2c4ba4129b1 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e96f6ace4b43c4b1ef8d989a67ef90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fd883d8bafd4e248467bbb7b0feb0c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:15.960285 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-601a10d5-77d1-460f-8faa-e2c4ba4129b1 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] 10.222.0.25 "GET /compute/v2.1/servers/fe309d4b-1169-4574-a57b-7e3c2cc5ddf4" status: 200 len: 1265 microversion: 2.1 time: 0.149670 May 27 03:43:15.960887 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 211/386] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:15 2021] GET /compute/v2.1/servers/fe309d4b-1169-4574-a57b-7e3c2cc5ddf4 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:15.966175 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-afd99794-adf3-46d6-a6d4-91978fd925b6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:15.967172 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-afd99794-adf3-46d6-a6d4-91978fd925b6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:15.974686 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-afd99794-adf3-46d6-a6d4-91978fd925b6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:15.975137 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-afd99794-adf3-46d6-a6d4-91978fd925b6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:15.975902 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-afd99794-adf3-46d6-a6d4-91978fd925b6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:15.976338 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-afd99794-adf3-46d6-a6d4-91978fd925b6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:16.122727 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-39dddf94-28f5-49d0-b37e-3411fe35f33b tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "POST /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0/action" status: 200 len: 32 microversion: 2.1 time: 0.642533 May 27 03:43:16.123331 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 176/387] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:43:15 2021] POST /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0/action => generated 32 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 03:43:16.128973 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-b5388525-4fc1-422a-b059-0bd561c2ae24 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:16.130028 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-b5388525-4fc1-422a-b059-0bd561c2ae24 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:16.137780 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b5388525-4fc1-422a-b059-0bd561c2ae24 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:16.138234 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b5388525-4fc1-422a-b059-0bd561c2ae24 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:16.139013 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b5388525-4fc1-422a-b059-0bd561c2ae24 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:16.139500 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b5388525-4fc1-422a-b059-0bd561c2ae24 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:16.310693 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-afd99794-adf3-46d6-a6d4-91978fd925b6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 28693 microversion: 2.20 time: 0.348507 May 27 03:43:16.311553 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 212/388] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:43:15 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 28693 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:43:16.317501 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-47d3d3e8-6407-416a-9f83-be10d673d2b4 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:16.318400 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-47d3d3e8-6407-416a-9f83-be10d673d2b4 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:16.326510 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-47d3d3e8-6407-416a-9f83-be10d673d2b4 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:16.326966 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-47d3d3e8-6407-416a-9f83-be10d673d2b4 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:16.329206 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-47d3d3e8-6407-416a-9f83-be10d673d2b4 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:16.329696 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-47d3d3e8-6407-416a-9f83-be10d673d2b4 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:16.357509 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-b5388525-4fc1-422a-b059-0bd561c2ae24 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28701 microversion: 2.1 time: 0.232759 May 27 03:43:16.358352 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 177/389] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:43:16 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28701 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:43:16.551957 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-47d3d3e8-6407-416a-9f83-be10d673d2b4 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:16.560908 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-47d3d3e8-6407-416a-9f83-be10d673d2b4 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0" status: 200 len: 1569 microversion: 2.1 time: 0.248048 May 27 03:43:16.562164 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 213/390] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:16 2021] GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0 => generated 1569 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:16.829637 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-37213d95-23c6-4feb-ae0f-49e5248464b6 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:16.830566 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-37213d95-23c6-4feb-ae0f-49e5248464b6 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 7caeff19-8b2a-4c81-b6f2-1178b3f1a561] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:16.838699 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-37213d95-23c6-4feb-ae0f-49e5248464b6 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:16.839148 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-37213d95-23c6-4feb-ae0f-49e5248464b6 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:16.840016 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-37213d95-23c6-4feb-ae0f-49e5248464b6 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:16.843355 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-37213d95-23c6-4feb-ae0f-49e5248464b6 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:16.978046 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-81fd9e80-2141-4bc8-ae60-43fc8500b5bd tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:16.978659 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-81fd9e80-2141-4bc8-ae60-43fc8500b5bd tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] [instance: fe309d4b-1169-4574-a57b-7e3c2cc5ddf4] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:16.986464 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-81fd9e80-2141-4bc8-ae60-43fc8500b5bd tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:16.986918 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-81fd9e80-2141-4bc8-ae60-43fc8500b5bd tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:16.987693 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-81fd9e80-2141-4bc8-ae60-43fc8500b5bd tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:16.988122 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-81fd9e80-2141-4bc8-ae60-43fc8500b5bd tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:17.110521 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-81fd9e80-2141-4bc8-ae60-43fc8500b5bd tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e96f6ace4b43c4b1ef8d989a67ef90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fd883d8bafd4e248467bbb7b0feb0c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:17.118925 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-81fd9e80-2141-4bc8-ae60-43fc8500b5bd tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] 10.222.0.25 "GET /compute/v2.1/servers/fe309d4b-1169-4574-a57b-7e3c2cc5ddf4" status: 200 len: 1283 microversion: 2.1 time: 0.145326 May 27 03:43:17.119481 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 214/391] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:16 2021] GET /compute/v2.1/servers/fe309d4b-1169-4574-a57b-7e3c2cc5ddf4 => generated 1283 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:43:17.323455 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-e92f11f9-1adb-4487-8a47-665e438f16cf tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:17.324348 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-e92f11f9-1adb-4487-8a47-665e438f16cf tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:17.332261 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e92f11f9-1adb-4487-8a47-665e438f16cf tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:17.333072 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e92f11f9-1adb-4487-8a47-665e438f16cf tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:17.333859 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e92f11f9-1adb-4487-8a47-665e438f16cf tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:17.334301 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e92f11f9-1adb-4487-8a47-665e438f16cf tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:17.456142 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-e92f11f9-1adb-4487-8a47-665e438f16cf tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 28693 microversion: 2.20 time: 0.136102 May 27 03:43:17.457158 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 215/392] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:43:17 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 28693 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 27 03:43:17.462421 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-73cd22de-7533-4bcd-9533-bd0e0325ecf3 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:17.463471 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-73cd22de-7533-4bcd-9533-bd0e0325ecf3 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:17.472479 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-73cd22de-7533-4bcd-9533-bd0e0325ecf3 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:17.473026 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-73cd22de-7533-4bcd-9533-bd0e0325ecf3 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:17.473811 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-73cd22de-7533-4bcd-9533-bd0e0325ecf3 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:17.474251 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-73cd22de-7533-4bcd-9533-bd0e0325ecf3 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:17.581907 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-73cd22de-7533-4bcd-9533-bd0e0325ecf3 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28701 microversion: 2.1 time: 0.123114 May 27 03:43:17.585814 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 216/393] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:43:17 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28701 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:43:17.591719 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [req-c624b45b-654f-444d-9b90-f6126024cb3e req-cc013f88-b4cf-4b41-a830-d148d638085f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7caeff19-8b2a-4c81-b6f2-1178b3f1a561", "tag": "c4a2f300-3a9c-46a1-a78d-8b27643ba00e"}]} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:17.591719 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:43:17.591719 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: warnings.warn(msg) May 27 03:43:17.598253 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-c624b45b-654f-444d-9b90-f6126024cb3e req-cc013f88-b4cf-4b41-a830-d148d638085f service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:17.598702 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-c624b45b-654f-444d-9b90-f6126024cb3e req-cc013f88-b4cf-4b41-a830-d148d638085f service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:17.614902 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.compute.server_external_events [req-c624b45b-654f-444d-9b90-f6126024cb3e req-cc013f88-b4cf-4b41-a830-d148d638085f service nova] Creating event network-changed:c4a2f300-3a9c-46a1-a78d-8b27643ba00e for instance 7caeff19-8b2a-4c81-b6f2-1178b3f1a561 on hv-cinder-79326 May 27 03:43:17.624429 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [req-c624b45b-654f-444d-9b90-f6126024cb3e req-cc013f88-b4cf-4b41-a830-d148d638085f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040459 May 27 03:43:17.625388 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 217/394] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:43:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:43:17.630761 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-4cb01846-1ac5-4b8f-97ec-0a1321d23258 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:17.632207 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-4cb01846-1ac5-4b8f-97ec-0a1321d23258 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:17.640857 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4cb01846-1ac5-4b8f-97ec-0a1321d23258 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:17.641311 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4cb01846-1ac5-4b8f-97ec-0a1321d23258 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:17.642701 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4cb01846-1ac5-4b8f-97ec-0a1321d23258 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:17.643215 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4cb01846-1ac5-4b8f-97ec-0a1321d23258 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:17.810970 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-37213d95-23c6-4feb-ae0f-49e5248464b6 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:17.831064 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-37213d95-23c6-4feb-ae0f-49e5248464b6 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/7caeff19-8b2a-4c81-b6f2-1178b3f1a561" status: 200 len: 1317 microversion: 2.1 time: 1.005922 May 27 03:43:17.832052 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 178/395] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:16 2021] GET /compute/v2.1/servers/7caeff19-8b2a-4c81-b6f2-1178b3f1a561 => generated 1317 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:17.876305 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-4cb01846-1ac5-4b8f-97ec-0a1321d23258 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:17.881001 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-4cb01846-1ac5-4b8f-97ec-0a1321d23258 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0" status: 200 len: 1569 microversion: 2.1 time: 0.254322 May 27 03:43:17.881877 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 218/396] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:17 2021] GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0 => generated 1569 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:18.134793 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-a998881a-309e-4c68-911b-a442bcbd2b63 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:18.135517 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-a998881a-309e-4c68-911b-a442bcbd2b63 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] [instance: fe309d4b-1169-4574-a57b-7e3c2cc5ddf4] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:18.143903 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a998881a-309e-4c68-911b-a442bcbd2b63 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:18.144468 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a998881a-309e-4c68-911b-a442bcbd2b63 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:18.145546 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a998881a-309e-4c68-911b-a442bcbd2b63 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:18.146056 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a998881a-309e-4c68-911b-a442bcbd2b63 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:18.300689 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-a998881a-309e-4c68-911b-a442bcbd2b63 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e96f6ace4b43c4b1ef8d989a67ef90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fd883d8bafd4e248467bbb7b0feb0c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:18.308755 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-a998881a-309e-4c68-911b-a442bcbd2b63 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] 10.222.0.25 "GET /compute/v2.1/servers/fe309d4b-1169-4574-a57b-7e3c2cc5ddf4" status: 200 len: 1271 microversion: 2.1 time: 0.177671 May 27 03:43:18.318661 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 179/397] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:18 2021] GET /compute/v2.1/servers/fe309d4b-1169-4574-a57b-7e3c2cc5ddf4 => generated 1271 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:18.467887 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-d9a1409e-24b3-4c80-b6eb-24b2b205e79b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:18.468910 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-d9a1409e-24b3-4c80-b6eb-24b2b205e79b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:18.476828 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d9a1409e-24b3-4c80-b6eb-24b2b205e79b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:18.477284 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d9a1409e-24b3-4c80-b6eb-24b2b205e79b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:18.478072 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d9a1409e-24b3-4c80-b6eb-24b2b205e79b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:18.478534 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d9a1409e-24b3-4c80-b6eb-24b2b205e79b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:18.594785 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-89dd5f82-a066-4dea-ab58-26dd0991d674 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:18.595848 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-89dd5f82-a066-4dea-ab58-26dd0991d674 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:18.603432 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-89dd5f82-a066-4dea-ab58-26dd0991d674 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:18.603880 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-89dd5f82-a066-4dea-ab58-26dd0991d674 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:18.604717 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-89dd5f82-a066-4dea-ab58-26dd0991d674 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:18.605149 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-89dd5f82-a066-4dea-ab58-26dd0991d674 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:18.868822 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-d9a1409e-24b3-4c80-b6eb-24b2b205e79b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 28693 microversion: 2.20 time: 0.404377 May 27 03:43:18.869491 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 219/398] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:43:18 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 28693 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:43:18.874441 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-dc521844-7849-4589-adef-b54fd5929eb8 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:18.875154 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-dc521844-7849-4589-adef-b54fd5929eb8 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 7caeff19-8b2a-4c81-b6f2-1178b3f1a561] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:18.883088 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-dc521844-7849-4589-adef-b54fd5929eb8 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:18.883545 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-dc521844-7849-4589-adef-b54fd5929eb8 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:18.884334 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-dc521844-7849-4589-adef-b54fd5929eb8 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:18.884817 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-dc521844-7849-4589-adef-b54fd5929eb8 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:18.891738 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-89dd5f82-a066-4dea-ab58-26dd0991d674 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28701 microversion: 2.1 time: 0.301769 May 27 03:43:18.894711 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 180/399] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:43:18 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28701 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:43:18.918986 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-9dbd93c3-b256-4950-b653-74f4a2b9263c tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:18.921310 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-9dbd93c3-b256-4950-b653-74f4a2b9263c tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:18.929569 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-9dbd93c3-b256-4950-b653-74f4a2b9263c tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:18.930959 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-9dbd93c3-b256-4950-b653-74f4a2b9263c tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:18.931980 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-9dbd93c3-b256-4950-b653-74f4a2b9263c tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:18.932655 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-9dbd93c3-b256-4950-b653-74f4a2b9263c tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:19.136173 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-dc521844-7849-4589-adef-b54fd5929eb8 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:19.144930 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-dc521844-7849-4589-adef-b54fd5929eb8 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/7caeff19-8b2a-4c81-b6f2-1178b3f1a561" status: 200 len: 1317 microversion: 2.1 time: 0.274122 May 27 03:43:19.145999 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 220/400] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:18 2021] GET /compute/v2.1/servers/7caeff19-8b2a-4c81-b6f2-1178b3f1a561 => generated 1317 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:19.325798 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-c22105e0-eb04-4954-90da-7ecde1b2aa6b tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:19.326406 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-c22105e0-eb04-4954-90da-7ecde1b2aa6b tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] [instance: fe309d4b-1169-4574-a57b-7e3c2cc5ddf4] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:19.334414 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c22105e0-eb04-4954-90da-7ecde1b2aa6b tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:19.334894 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c22105e0-eb04-4954-90da-7ecde1b2aa6b tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:19.335695 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c22105e0-eb04-4954-90da-7ecde1b2aa6b tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:19.336127 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c22105e0-eb04-4954-90da-7ecde1b2aa6b tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:19.489139 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-9dbd93c3-b256-4950-b653-74f4a2b9263c tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:19.498765 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-9dbd93c3-b256-4950-b653-74f4a2b9263c tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0" status: 200 len: 1569 microversion: 2.1 time: 0.602310 May 27 03:43:19.499769 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 181/401] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:18 2021] GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0 => generated 1569 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:19.554512 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-c22105e0-eb04-4954-90da-7ecde1b2aa6b tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e96f6ace4b43c4b1ef8d989a67ef90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fd883d8bafd4e248467bbb7b0feb0c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:19.563415 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-c22105e0-eb04-4954-90da-7ecde1b2aa6b tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] 10.222.0.25 "GET /compute/v2.1/servers/fe309d4b-1169-4574-a57b-7e3c2cc5ddf4" status: 200 len: 1313 microversion: 2.1 time: 0.241245 May 27 03:43:19.564897 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 221/402] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:19 2021] GET /compute/v2.1/servers/fe309d4b-1169-4574-a57b-7e3c2cc5ddf4 => generated 1313 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:43:19.881536 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-1aa4acb6-ead0-428a-8237-d210d5ac3aa4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:19.882517 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-1aa4acb6-ead0-428a-8237-d210d5ac3aa4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:19.889906 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1aa4acb6-ead0-428a-8237-d210d5ac3aa4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:19.890362 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1aa4acb6-ead0-428a-8237-d210d5ac3aa4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:19.891132 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1aa4acb6-ead0-428a-8237-d210d5ac3aa4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:19.891572 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1aa4acb6-ead0-428a-8237-d210d5ac3aa4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:19.904717 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-00b43ea3-05a3-4343-b3ec-93a68259c83f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:19.905930 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-00b43ea3-05a3-4343-b3ec-93a68259c83f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:19.920354 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-00b43ea3-05a3-4343-b3ec-93a68259c83f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:19.925201 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-00b43ea3-05a3-4343-b3ec-93a68259c83f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:19.925201 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-00b43ea3-05a3-4343-b3ec-93a68259c83f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:19.925201 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-00b43ea3-05a3-4343-b3ec-93a68259c83f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:20.033676 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-00b43ea3-05a3-4343-b3ec-93a68259c83f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28701 microversion: 2.1 time: 0.132521 May 27 03:43:20.034697 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 222/403] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:43:19 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28701 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 03:43:20.038621 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-1aa4acb6-ead0-428a-8237-d210d5ac3aa4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 28693 microversion: 2.20 time: 0.160640 May 27 03:43:20.039571 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 182/404] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:43:19 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 28693 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:43:20.165357 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-303f9cf3-4af9-4b50-94b6-f794bd0ba6e8 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:20.166317 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-303f9cf3-4af9-4b50-94b6-f794bd0ba6e8 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 7caeff19-8b2a-4c81-b6f2-1178b3f1a561] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:20.174844 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-303f9cf3-4af9-4b50-94b6-f794bd0ba6e8 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:20.175297 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-303f9cf3-4af9-4b50-94b6-f794bd0ba6e8 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:20.176072 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-303f9cf3-4af9-4b50-94b6-f794bd0ba6e8 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:20.176544 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-303f9cf3-4af9-4b50-94b6-f794bd0ba6e8 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:20.378943 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-303f9cf3-4af9-4b50-94b6-f794bd0ba6e8 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:20.384302 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-303f9cf3-4af9-4b50-94b6-f794bd0ba6e8 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/7caeff19-8b2a-4c81-b6f2-1178b3f1a561" status: 200 len: 1317 microversion: 2.1 time: 0.223063 May 27 03:43:20.384899 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 223/405] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:20 2021] GET /compute/v2.1/servers/7caeff19-8b2a-4c81-b6f2-1178b3f1a561 => generated 1317 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:20.516260 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-97095d5b-5276-4d20-bc68-16397a24a2b4 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:20.516988 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-97095d5b-5276-4d20-bc68-16397a24a2b4 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:20.525009 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-97095d5b-5276-4d20-bc68-16397a24a2b4 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:20.525462 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-97095d5b-5276-4d20-bc68-16397a24a2b4 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:20.526228 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-97095d5b-5276-4d20-bc68-16397a24a2b4 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:20.526666 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-97095d5b-5276-4d20-bc68-16397a24a2b4 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:20.582856 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-5da892ea-d764-4a5b-9f1c-3dfa86082067 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:20.584652 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-5da892ea-d764-4a5b-9f1c-3dfa86082067 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] [instance: fe309d4b-1169-4574-a57b-7e3c2cc5ddf4] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:20.593042 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-5da892ea-d764-4a5b-9f1c-3dfa86082067 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:20.593800 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-5da892ea-d764-4a5b-9f1c-3dfa86082067 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:20.595535 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-5da892ea-d764-4a5b-9f1c-3dfa86082067 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:20.596050 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-5da892ea-d764-4a5b-9f1c-3dfa86082067 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:20.887932 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-5da892ea-d764-4a5b-9f1c-3dfa86082067 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e96f6ace4b43c4b1ef8d989a67ef90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fd883d8bafd4e248467bbb7b0feb0c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:20.896590 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-5da892ea-d764-4a5b-9f1c-3dfa86082067 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] 10.222.0.25 "GET /compute/v2.1/servers/fe309d4b-1169-4574-a57b-7e3c2cc5ddf4" status: 200 len: 1313 microversion: 2.1 time: 0.318595 May 27 03:43:20.897146 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 224/406] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:20 2021] GET /compute/v2.1/servers/fe309d4b-1169-4574-a57b-7e3c2cc5ddf4 => generated 1313 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:20.898845 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-97095d5b-5276-4d20-bc68-16397a24a2b4 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:20.908261 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-97095d5b-5276-4d20-bc68-16397a24a2b4 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0" status: 200 len: 1569 microversion: 2.1 time: 0.395499 May 27 03:43:20.908864 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 183/407] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:20 2021] GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0 => generated 1569 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:43:21.046164 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-81ac31f8-8383-4fc8-9038-1056c9a8595d tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:21.047990 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-81ac31f8-8383-4fc8-9038-1056c9a8595d tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:21.055538 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-eebb5321-477c-4a47-8b78-358e035b7f0f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:21.058218 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-81ac31f8-8383-4fc8-9038-1056c9a8595d tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:21.059608 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-eebb5321-477c-4a47-8b78-358e035b7f0f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:21.059710 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-81ac31f8-8383-4fc8-9038-1056c9a8595d tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:21.059710 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-81ac31f8-8383-4fc8-9038-1056c9a8595d tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:21.060129 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-81ac31f8-8383-4fc8-9038-1056c9a8595d tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:21.066482 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-eebb5321-477c-4a47-8b78-358e035b7f0f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:21.067016 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-eebb5321-477c-4a47-8b78-358e035b7f0f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:21.068011 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-eebb5321-477c-4a47-8b78-358e035b7f0f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:21.068644 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-eebb5321-477c-4a47-8b78-358e035b7f0f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:21.444764 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-81ac31f8-8383-4fc8-9038-1056c9a8595d tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28701 microversion: 2.1 time: 0.401876 May 27 03:43:21.447666 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-eebb5321-477c-4a47-8b78-358e035b7f0f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 28693 microversion: 2.20 time: 0.399641 May 27 03:43:21.448449 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 225/408] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:43:21 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28701 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:43:21.452820 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 184/409] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:43:21 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 28693 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 27 03:43:21.454353 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [req-92560a1b-4caa-4645-a14b-753fb7d7193d req-7e623209-70df-4a24-903d-9d96c676d7f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe309d4b-1169-4574-a57b-7e3c2cc5ddf4", "tag": "b0b1cc61-eef3-4210-b550-01a9151eae95"}]} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:21.455889 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:43:21.455889 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: warnings.warn(msg) May 27 03:43:21.458879 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-c8c4330b-2dc0-4816-8cdb-8a85b203f52d tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:21.459833 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-c8c4330b-2dc0-4816-8cdb-8a85b203f52d tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 7caeff19-8b2a-4c81-b6f2-1178b3f1a561] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:21.465369 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-92560a1b-4caa-4645-a14b-753fb7d7193d req-7e623209-70df-4a24-903d-9d96c676d7f3 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:21.465369 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-92560a1b-4caa-4645-a14b-753fb7d7193d req-7e623209-70df-4a24-903d-9d96c676d7f3 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:21.467797 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c8c4330b-2dc0-4816-8cdb-8a85b203f52d tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:21.468249 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c8c4330b-2dc0-4816-8cdb-8a85b203f52d tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:21.469050 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c8c4330b-2dc0-4816-8cdb-8a85b203f52d tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:21.469486 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c8c4330b-2dc0-4816-8cdb-8a85b203f52d tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:21.480953 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.compute.server_external_events [req-92560a1b-4caa-4645-a14b-753fb7d7193d req-7e623209-70df-4a24-903d-9d96c676d7f3 service nova] Creating event network-changed:b0b1cc61-eef3-4210-b550-01a9151eae95 for instance fe309d4b-1169-4574-a57b-7e3c2cc5ddf4 on hv-cinder-79326 May 27 03:43:21.486070 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [req-92560a1b-4caa-4645-a14b-753fb7d7193d req-7e623209-70df-4a24-903d-9d96c676d7f3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035759 May 27 03:43:21.486818 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 226/410] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:43:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:43:21.759278 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-c8c4330b-2dc0-4816-8cdb-8a85b203f52d tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:21.768388 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-c8c4330b-2dc0-4816-8cdb-8a85b203f52d tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/7caeff19-8b2a-4c81-b6f2-1178b3f1a561" status: 200 len: 1317 microversion: 2.1 time: 0.313167 May 27 03:43:21.768388 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 185/411] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:21 2021] GET /compute/v2.1/servers/7caeff19-8b2a-4c81-b6f2-1178b3f1a561 => generated 1317 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:21.913083 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-d923946e-b136-4ef8-b1d9-ad8e373313eb tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:21.913895 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-d923946e-b136-4ef8-b1d9-ad8e373313eb tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] [instance: fe309d4b-1169-4574-a57b-7e3c2cc5ddf4] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:21.921690 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d923946e-b136-4ef8-b1d9-ad8e373313eb tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:21.922142 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d923946e-b136-4ef8-b1d9-ad8e373313eb tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:21.922916 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d923946e-b136-4ef8-b1d9-ad8e373313eb tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:21.924319 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d923946e-b136-4ef8-b1d9-ad8e373313eb tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:21.925999 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-767a89ad-8f46-4f5b-a3cb-a9102a74cf1c tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:21.926690 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-767a89ad-8f46-4f5b-a3cb-a9102a74cf1c tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:21.933888 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-767a89ad-8f46-4f5b-a3cb-a9102a74cf1c tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:21.934412 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-767a89ad-8f46-4f5b-a3cb-a9102a74cf1c tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:21.935251 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-767a89ad-8f46-4f5b-a3cb-a9102a74cf1c tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:21.935757 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-767a89ad-8f46-4f5b-a3cb-a9102a74cf1c tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:22.123991 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-d923946e-b136-4ef8-b1d9-ad8e373313eb tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e96f6ace4b43c4b1ef8d989a67ef90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fd883d8bafd4e248467bbb7b0feb0c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:22.132466 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-d923946e-b136-4ef8-b1d9-ad8e373313eb tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] 10.222.0.25 "GET /compute/v2.1/servers/fe309d4b-1169-4574-a57b-7e3c2cc5ddf4" status: 200 len: 1313 microversion: 2.1 time: 0.223422 May 27 03:43:22.133046 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 227/412] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:21 2021] GET /compute/v2.1/servers/fe309d4b-1169-4574-a57b-7e3c2cc5ddf4 => generated 1313 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:22.160014 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-767a89ad-8f46-4f5b-a3cb-a9102a74cf1c tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:22.168968 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-767a89ad-8f46-4f5b-a3cb-a9102a74cf1c tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0" status: 200 len: 1569 microversion: 2.1 time: 0.247589 May 27 03:43:22.169527 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 186/413] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:21 2021] GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0 => generated 1569 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:43:22.458599 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-1a3434d0-e35c-432c-8fa1-191516967e9f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:22.463610 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-2def17bc-11be-418d-aa60-d0bc90371184 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:22.464570 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-2def17bc-11be-418d-aa60-d0bc90371184 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:22.469591 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-1a3434d0-e35c-432c-8fa1-191516967e9f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:22.478271 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1a3434d0-e35c-432c-8fa1-191516967e9f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:22.478631 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2def17bc-11be-418d-aa60-d0bc90371184 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:22.479091 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2def17bc-11be-418d-aa60-d0bc90371184 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:22.479246 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1a3434d0-e35c-432c-8fa1-191516967e9f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:22.479877 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2def17bc-11be-418d-aa60-d0bc90371184 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:22.480258 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1a3434d0-e35c-432c-8fa1-191516967e9f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:22.480366 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2def17bc-11be-418d-aa60-d0bc90371184 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:22.480902 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1a3434d0-e35c-432c-8fa1-191516967e9f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:23.169475 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-1a3434d0-e35c-432c-8fa1-191516967e9f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28701 microversion: 2.1 time: 0.715452 May 27 03:43:23.170473 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 228/414] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:43:22 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28701 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:43:23.172765 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-2def17bc-11be-418d-aa60-d0bc90371184 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 28693 microversion: 2.20 time: 0.712603 May 27 03:43:23.173962 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 187/415] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:43:22 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 28693 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:43:23.176113 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-9723e4de-b0f8-48f6-8e23-c61d4f0c67f5 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:23.176845 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-9723e4de-b0f8-48f6-8e23-c61d4f0c67f5 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 7caeff19-8b2a-4c81-b6f2-1178b3f1a561] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:23.178906 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-66976bc9-ca52-4c00-bff2-ff9719dcc768 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:23.179627 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-66976bc9-ca52-4c00-bff2-ff9719dcc768 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] [instance: fe309d4b-1169-4574-a57b-7e3c2cc5ddf4] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:23.184722 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9723e4de-b0f8-48f6-8e23-c61d4f0c67f5 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:23.185182 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9723e4de-b0f8-48f6-8e23-c61d4f0c67f5 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:23.185981 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9723e4de-b0f8-48f6-8e23-c61d4f0c67f5 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:23.186438 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9723e4de-b0f8-48f6-8e23-c61d4f0c67f5 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:23.187352 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-66976bc9-ca52-4c00-bff2-ff9719dcc768 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:23.187799 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-66976bc9-ca52-4c00-bff2-ff9719dcc768 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:23.189176 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-66976bc9-ca52-4c00-bff2-ff9719dcc768 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:23.189879 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-66976bc9-ca52-4c00-bff2-ff9719dcc768 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:23.393713 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-9723e4de-b0f8-48f6-8e23-c61d4f0c67f5 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:23.402261 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-9723e4de-b0f8-48f6-8e23-c61d4f0c67f5 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/7caeff19-8b2a-4c81-b6f2-1178b3f1a561" status: 200 len: 1317 microversion: 2.1 time: 0.230353 May 27 03:43:23.410959 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 229/416] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:23 2021] GET /compute/v2.1/servers/7caeff19-8b2a-4c81-b6f2-1178b3f1a561 => generated 1317 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:23.410959 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-d460403c-c861-4981-ad42-4aba1c605c35 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:23.410959 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-d460403c-c861-4981-ad42-4aba1c605c35 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:23.415858 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d460403c-c861-4981-ad42-4aba1c605c35 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:23.416316 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d460403c-c861-4981-ad42-4aba1c605c35 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:23.417170 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d460403c-c861-4981-ad42-4aba1c605c35 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:23.417610 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d460403c-c861-4981-ad42-4aba1c605c35 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:23.567871 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-66976bc9-ca52-4c00-bff2-ff9719dcc768 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e96f6ace4b43c4b1ef8d989a67ef90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fd883d8bafd4e248467bbb7b0feb0c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:23.576483 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-66976bc9-ca52-4c00-bff2-ff9719dcc768 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] 10.222.0.25 "GET /compute/v2.1/servers/fe309d4b-1169-4574-a57b-7e3c2cc5ddf4" status: 200 len: 1313 microversion: 2.1 time: 0.401208 May 27 03:43:23.577055 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 188/417] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:23 2021] GET /compute/v2.1/servers/fe309d4b-1169-4574-a57b-7e3c2cc5ddf4 => generated 1313 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:23.616056 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-d460403c-c861-4981-ad42-4aba1c605c35 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:23.624599 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-d460403c-c861-4981-ad42-4aba1c605c35 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0" status: 200 len: 1569 microversion: 2.1 time: 0.220772 May 27 03:43:23.625162 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 230/418] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:23 2021] GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0 => generated 1569 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:24.180850 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-5feff751-d381-4c09-88be-3cbda5f3e7cf tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:24.181850 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-5feff751-d381-4c09-88be-3cbda5f3e7cf tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:24.184690 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-1bd0df6d-d168-44d3-a73e-757d97734837 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:24.185699 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-1bd0df6d-d168-44d3-a73e-757d97734837 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:24.190418 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-5feff751-d381-4c09-88be-3cbda5f3e7cf tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:24.190880 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-5feff751-d381-4c09-88be-3cbda5f3e7cf tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:24.191669 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-5feff751-d381-4c09-88be-3cbda5f3e7cf tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:24.192110 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-5feff751-d381-4c09-88be-3cbda5f3e7cf tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:24.194011 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1bd0df6d-d168-44d3-a73e-757d97734837 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:24.194463 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1bd0df6d-d168-44d3-a73e-757d97734837 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:24.195339 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1bd0df6d-d168-44d3-a73e-757d97734837 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:24.195772 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1bd0df6d-d168-44d3-a73e-757d97734837 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:24.691903 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-1bd0df6d-d168-44d3-a73e-757d97734837 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 28693 microversion: 2.20 time: 0.510650 May 27 03:43:24.692767 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 231/419] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:43:24 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 28693 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 27 03:43:24.696772 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-5feff751-d381-4c09-88be-3cbda5f3e7cf tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28701 microversion: 2.1 time: 0.518950 May 27 03:43:24.697894 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 189/420] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:43:24 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28701 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:43:24.698937 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-156611e9-00f4-4fc2-a19c-f9a207ee5e31 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:24.699664 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-156611e9-00f4-4fc2-a19c-f9a207ee5e31 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 7caeff19-8b2a-4c81-b6f2-1178b3f1a561] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:24.704362 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-b8715646-ad7b-4770-8728-f30e4e5eb29e tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:24.705353 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-b8715646-ad7b-4770-8728-f30e4e5eb29e tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] [instance: fe309d4b-1169-4574-a57b-7e3c2cc5ddf4] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:24.708233 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-156611e9-00f4-4fc2-a19c-f9a207ee5e31 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:24.708725 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-156611e9-00f4-4fc2-a19c-f9a207ee5e31 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:24.709532 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-156611e9-00f4-4fc2-a19c-f9a207ee5e31 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:24.709972 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-156611e9-00f4-4fc2-a19c-f9a207ee5e31 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:24.714937 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b8715646-ad7b-4770-8728-f30e4e5eb29e tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:24.715522 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b8715646-ad7b-4770-8728-f30e4e5eb29e tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:24.716568 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b8715646-ad7b-4770-8728-f30e4e5eb29e tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:24.717028 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b8715646-ad7b-4770-8728-f30e4e5eb29e tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:24.905285 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-156611e9-00f4-4fc2-a19c-f9a207ee5e31 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:24.914289 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-156611e9-00f4-4fc2-a19c-f9a207ee5e31 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/7caeff19-8b2a-4c81-b6f2-1178b3f1a561" status: 200 len: 1317 microversion: 2.1 time: 0.220532 May 27 03:43:24.914949 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 232/421] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:24 2021] GET /compute/v2.1/servers/7caeff19-8b2a-4c81-b6f2-1178b3f1a561 => generated 1317 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:24.916024 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-b8715646-ad7b-4770-8728-f30e4e5eb29e tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e96f6ace4b43c4b1ef8d989a67ef90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fd883d8bafd4e248467bbb7b0feb0c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:24.919737 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-9818b10b-999c-4f5a-a449-6e6c50a60412 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:24.920440 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-9818b10b-999c-4f5a-a449-6e6c50a60412 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:24.925104 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-b8715646-ad7b-4770-8728-f30e4e5eb29e tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] 10.222.0.25 "GET /compute/v2.1/servers/fe309d4b-1169-4574-a57b-7e3c2cc5ddf4" status: 200 len: 1313 microversion: 2.1 time: 0.226244 May 27 03:43:24.925739 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 190/422] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:24 2021] GET /compute/v2.1/servers/fe309d4b-1169-4574-a57b-7e3c2cc5ddf4 => generated 1313 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:24.928262 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9818b10b-999c-4f5a-a449-6e6c50a60412 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:24.928733 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9818b10b-999c-4f5a-a449-6e6c50a60412 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:24.929510 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9818b10b-999c-4f5a-a449-6e6c50a60412 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:24.929947 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9818b10b-999c-4f5a-a449-6e6c50a60412 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:25.127951 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-9818b10b-999c-4f5a-a449-6e6c50a60412 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:25.136540 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-9818b10b-999c-4f5a-a449-6e6c50a60412 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0" status: 200 len: 1569 microversion: 2.1 time: 0.220253 May 27 03:43:25.137103 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 233/423] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:24 2021] GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0 => generated 1569 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:25.702995 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-418a5b4c-20c1-457f-b606-944aa0cd0f7e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:25.703935 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-418a5b4c-20c1-457f-b606-944aa0cd0f7e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:25.708978 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-4ebc77bf-703f-4d80-ab50-a46c0390e64e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:25.709907 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-4ebc77bf-703f-4d80-ab50-a46c0390e64e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:25.711855 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-418a5b4c-20c1-457f-b606-944aa0cd0f7e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:25.712310 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-418a5b4c-20c1-457f-b606-944aa0cd0f7e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:25.713116 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-418a5b4c-20c1-457f-b606-944aa0cd0f7e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:25.713556 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-418a5b4c-20c1-457f-b606-944aa0cd0f7e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:25.717418 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4ebc77bf-703f-4d80-ab50-a46c0390e64e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:25.717877 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4ebc77bf-703f-4d80-ab50-a46c0390e64e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:25.718651 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4ebc77bf-703f-4d80-ab50-a46c0390e64e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:25.719094 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4ebc77bf-703f-4d80-ab50-a46c0390e64e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:25.998223 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-418a5b4c-20c1-457f-b606-944aa0cd0f7e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 28693 microversion: 2.20 time: 0.298675 May 27 03:43:25.999060 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 191/424] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:43:25 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 28693 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 27 03:43:26.004731 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-f507fc65-d13f-4c79-8ac2-fdce1db762b0 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:26.005439 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-f507fc65-d13f-4c79-8ac2-fdce1db762b0 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 7caeff19-8b2a-4c81-b6f2-1178b3f1a561] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:26.013197 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f507fc65-d13f-4c79-8ac2-fdce1db762b0 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:26.013660 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f507fc65-d13f-4c79-8ac2-fdce1db762b0 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:26.014439 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f507fc65-d13f-4c79-8ac2-fdce1db762b0 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:26.014886 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f507fc65-d13f-4c79-8ac2-fdce1db762b0 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:26.083294 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-4ebc77bf-703f-4d80-ab50-a46c0390e64e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28701 microversion: 2.1 time: 0.378358 May 27 03:43:26.084448 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 234/425] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:43:25 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28701 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 03:43:26.088795 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-755f8b63-ce18-48cc-a8c7-1ccabfaf3815 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:26.089499 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-755f8b63-ce18-48cc-a8c7-1ccabfaf3815 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] [instance: fe309d4b-1169-4574-a57b-7e3c2cc5ddf4] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:26.097216 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-755f8b63-ce18-48cc-a8c7-1ccabfaf3815 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:26.097677 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-755f8b63-ce18-48cc-a8c7-1ccabfaf3815 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:26.098465 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-755f8b63-ce18-48cc-a8c7-1ccabfaf3815 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:26.098916 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-755f8b63-ce18-48cc-a8c7-1ccabfaf3815 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:26.231270 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-f507fc65-d13f-4c79-8ac2-fdce1db762b0 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:26.242145 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-f507fc65-d13f-4c79-8ac2-fdce1db762b0 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/7caeff19-8b2a-4c81-b6f2-1178b3f1a561" status: 200 len: 1317 microversion: 2.1 time: 0.241736 May 27 03:43:26.243025 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 192/426] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:25 2021] GET /compute/v2.1/servers/7caeff19-8b2a-4c81-b6f2-1178b3f1a561 => generated 1317 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:26.247392 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-92531331-cd75-492c-985d-63827044e2ce tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:26.248136 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-92531331-cd75-492c-985d-63827044e2ce tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:26.258314 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-92531331-cd75-492c-985d-63827044e2ce tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:26.258983 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-92531331-cd75-492c-985d-63827044e2ce tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:26.260251 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-92531331-cd75-492c-985d-63827044e2ce tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:26.260725 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-92531331-cd75-492c-985d-63827044e2ce tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:26.331294 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-755f8b63-ce18-48cc-a8c7-1ccabfaf3815 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e96f6ace4b43c4b1ef8d989a67ef90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fd883d8bafd4e248467bbb7b0feb0c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:26.339773 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-755f8b63-ce18-48cc-a8c7-1ccabfaf3815 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] 10.222.0.25 "GET /compute/v2.1/servers/fe309d4b-1169-4574-a57b-7e3c2cc5ddf4" status: 200 len: 1313 microversion: 2.1 time: 0.254660 May 27 03:43:26.340287 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 235/427] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:26 2021] GET /compute/v2.1/servers/fe309d4b-1169-4574-a57b-7e3c2cc5ddf4 => generated 1313 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:26.468990 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-92531331-cd75-492c-985d-63827044e2ce tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:26.478221 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-92531331-cd75-492c-985d-63827044e2ce tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0" status: 200 len: 1569 microversion: 2.1 time: 0.234488 May 27 03:43:26.478789 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 193/428] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:26 2021] GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0 => generated 1569 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:27.010856 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-633ca04a-78bd-4191-bed6-1e7c67b0095e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:27.011844 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-633ca04a-78bd-4191-bed6-1e7c67b0095e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:27.019792 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-633ca04a-78bd-4191-bed6-1e7c67b0095e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:27.020237 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-633ca04a-78bd-4191-bed6-1e7c67b0095e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:27.021033 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-633ca04a-78bd-4191-bed6-1e7c67b0095e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:27.021465 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-633ca04a-78bd-4191-bed6-1e7c67b0095e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:27.094957 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-6910b2bb-34dd-4275-9796-3bf9a8f3317d tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:27.095937 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-6910b2bb-34dd-4275-9796-3bf9a8f3317d tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:27.103671 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6910b2bb-34dd-4275-9796-3bf9a8f3317d tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:27.104127 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6910b2bb-34dd-4275-9796-3bf9a8f3317d tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:27.104946 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6910b2bb-34dd-4275-9796-3bf9a8f3317d tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:27.105383 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6910b2bb-34dd-4275-9796-3bf9a8f3317d tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:27.163892 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-633ca04a-78bd-4191-bed6-1e7c67b0095e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 28693 microversion: 2.20 time: 0.156432 May 27 03:43:27.164660 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 236/429] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:43:27 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 28693 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:43:27.245028 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-6910b2bb-34dd-4275-9796-3bf9a8f3317d tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28701 microversion: 2.1 time: 0.153391 May 27 03:43:27.245677 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 194/430] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:43:27 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28701 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 03:43:27.258914 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-aa8f2420-d3a5-4099-9a95-7e29d70705ee tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:27.259637 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-aa8f2420-d3a5-4099-9a95-7e29d70705ee tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 7caeff19-8b2a-4c81-b6f2-1178b3f1a561] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:27.268246 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-aa8f2420-d3a5-4099-9a95-7e29d70705ee tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:27.268665 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-aa8f2420-d3a5-4099-9a95-7e29d70705ee tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:27.269427 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-aa8f2420-d3a5-4099-9a95-7e29d70705ee tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:27.269859 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-aa8f2420-d3a5-4099-9a95-7e29d70705ee tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:27.357708 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-2e75f200-64b9-4731-bbfa-d15804b1b4b3 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:27.358521 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-2e75f200-64b9-4731-bbfa-d15804b1b4b3 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] [instance: fe309d4b-1169-4574-a57b-7e3c2cc5ddf4] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:27.367250 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2e75f200-64b9-4731-bbfa-d15804b1b4b3 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:27.367914 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2e75f200-64b9-4731-bbfa-d15804b1b4b3 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:27.369137 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2e75f200-64b9-4731-bbfa-d15804b1b4b3 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:27.370274 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2e75f200-64b9-4731-bbfa-d15804b1b4b3 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:27.482989 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-aa8f2420-d3a5-4099-9a95-7e29d70705ee tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:27.495002 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-aa8f2420-d3a5-4099-9a95-7e29d70705ee tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/7caeff19-8b2a-4c81-b6f2-1178b3f1a561" status: 200 len: 1317 microversion: 2.1 time: 0.239575 May 27 03:43:27.496004 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 237/431] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:27 2021] GET /compute/v2.1/servers/7caeff19-8b2a-4c81-b6f2-1178b3f1a561 => generated 1317 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:27.501650 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-cc0baadf-2ccc-43cd-a387-610e8dec78e6 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:27.502450 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-cc0baadf-2ccc-43cd-a387-610e8dec78e6 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:27.510400 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-cc0baadf-2ccc-43cd-a387-610e8dec78e6 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:27.511009 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-cc0baadf-2ccc-43cd-a387-610e8dec78e6 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:27.511896 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-cc0baadf-2ccc-43cd-a387-610e8dec78e6 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:27.512470 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-cc0baadf-2ccc-43cd-a387-610e8dec78e6 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:27.587498 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-2e75f200-64b9-4731-bbfa-d15804b1b4b3 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e96f6ace4b43c4b1ef8d989a67ef90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fd883d8bafd4e248467bbb7b0feb0c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:27.596087 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-2e75f200-64b9-4731-bbfa-d15804b1b4b3 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] 10.222.0.25 "GET /compute/v2.1/servers/fe309d4b-1169-4574-a57b-7e3c2cc5ddf4" status: 200 len: 1313 microversion: 2.1 time: 0.242413 May 27 03:43:27.597032 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 195/432] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:27 2021] GET /compute/v2.1/servers/fe309d4b-1169-4574-a57b-7e3c2cc5ddf4 => generated 1313 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:27.718872 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-cc0baadf-2ccc-43cd-a387-610e8dec78e6 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:27.728171 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-cc0baadf-2ccc-43cd-a387-610e8dec78e6 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0" status: 200 len: 1569 microversion: 2.1 time: 0.230590 May 27 03:43:27.729048 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 238/433] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:27 2021] GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0 => generated 1569 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:28.175651 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-5db95559-4fb1-4aee-91c7-803f48df1c25 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:28.176524 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-5db95559-4fb1-4aee-91c7-803f48df1c25 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:28.183712 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-5db95559-4fb1-4aee-91c7-803f48df1c25 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:28.184161 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-5db95559-4fb1-4aee-91c7-803f48df1c25 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:28.184961 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-5db95559-4fb1-4aee-91c7-803f48df1c25 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:28.185396 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-5db95559-4fb1-4aee-91c7-803f48df1c25 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:28.256241 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-e1e6d6fe-d166-4fd8-bd3c-01020d67e7c3 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:28.257201 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-e1e6d6fe-d166-4fd8-bd3c-01020d67e7c3 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:28.264746 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e1e6d6fe-d166-4fd8-bd3c-01020d67e7c3 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:28.265200 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e1e6d6fe-d166-4fd8-bd3c-01020d67e7c3 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:28.265967 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e1e6d6fe-d166-4fd8-bd3c-01020d67e7c3 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:28.266405 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e1e6d6fe-d166-4fd8-bd3c-01020d67e7c3 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:28.479412 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-e1e6d6fe-d166-4fd8-bd3c-01020d67e7c3 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28701 microversion: 2.1 time: 0.226320 May 27 03:43:28.480292 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 239/434] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:43:28 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28701 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 03:43:28.487251 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-5db95559-4fb1-4aee-91c7-803f48df1c25 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 28693 microversion: 2.20 time: 0.315137 May 27 03:43:28.491358 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 196/435] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:43:28 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 28693 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:43:28.512770 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-c3a504b0-a43f-4c4f-afd8-49c564ebad6a tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:28.513476 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-c3a504b0-a43f-4c4f-afd8-49c564ebad6a tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 7caeff19-8b2a-4c81-b6f2-1178b3f1a561] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:28.522440 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c3a504b0-a43f-4c4f-afd8-49c564ebad6a tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:28.522888 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c3a504b0-a43f-4c4f-afd8-49c564ebad6a tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:28.523669 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c3a504b0-a43f-4c4f-afd8-49c564ebad6a tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:28.524104 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c3a504b0-a43f-4c4f-afd8-49c564ebad6a tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:28.612580 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-473481ae-52aa-4f68-9c4d-fda8803ce721 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:28.613395 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-473481ae-52aa-4f68-9c4d-fda8803ce721 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] [instance: fe309d4b-1169-4574-a57b-7e3c2cc5ddf4] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:28.621369 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-473481ae-52aa-4f68-9c4d-fda8803ce721 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:28.621824 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-473481ae-52aa-4f68-9c4d-fda8803ce721 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:28.622603 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-473481ae-52aa-4f68-9c4d-fda8803ce721 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:28.623045 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-473481ae-52aa-4f68-9c4d-fda8803ce721 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:28.721311 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-c3a504b0-a43f-4c4f-afd8-49c564ebad6a tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:28.729546 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-c3a504b0-a43f-4c4f-afd8-49c564ebad6a tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/7caeff19-8b2a-4c81-b6f2-1178b3f1a561" status: 200 len: 1317 microversion: 2.1 time: 0.220838 May 27 03:43:28.730054 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 240/436] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:28 2021] GET /compute/v2.1/servers/7caeff19-8b2a-4c81-b6f2-1178b3f1a561 => generated 1317 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:28.745506 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-6007d35c-664b-4e4e-96e4-37988ee5bb9c tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:28.746107 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-6007d35c-664b-4e4e-96e4-37988ee5bb9c tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:28.753921 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6007d35c-664b-4e4e-96e4-37988ee5bb9c tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:28.754371 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6007d35c-664b-4e4e-96e4-37988ee5bb9c tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:28.755133 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6007d35c-664b-4e4e-96e4-37988ee5bb9c tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:28.755567 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6007d35c-664b-4e4e-96e4-37988ee5bb9c tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:28.822087 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-473481ae-52aa-4f68-9c4d-fda8803ce721 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e96f6ace4b43c4b1ef8d989a67ef90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fd883d8bafd4e248467bbb7b0feb0c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:28.839153 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-473481ae-52aa-4f68-9c4d-fda8803ce721 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] 10.222.0.25 "GET /compute/v2.1/servers/fe309d4b-1169-4574-a57b-7e3c2cc5ddf4" status: 200 len: 1313 microversion: 2.1 time: 0.230706 May 27 03:43:28.840257 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 197/437] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:28 2021] GET /compute/v2.1/servers/fe309d4b-1169-4574-a57b-7e3c2cc5ddf4 => generated 1313 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:43:28.969922 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-6007d35c-664b-4e4e-96e4-37988ee5bb9c tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:28.978597 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-6007d35c-664b-4e4e-96e4-37988ee5bb9c tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0" status: 200 len: 1569 microversion: 2.1 time: 0.236654 May 27 03:43:28.979627 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 241/438] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:28 2021] GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0 => generated 1569 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:43:29.491398 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-0c217ead-c72a-4f8c-893c-1f8012b18be3 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:29.492328 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-0c217ead-c72a-4f8c-893c-1f8012b18be3 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:29.498853 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-a35099b7-1483-48d8-b0a0-96538fb44d1f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:29.499651 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-0c217ead-c72a-4f8c-893c-1f8012b18be3 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:29.499780 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-a35099b7-1483-48d8-b0a0-96538fb44d1f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:29.500106 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-0c217ead-c72a-4f8c-893c-1f8012b18be3 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:29.500949 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-0c217ead-c72a-4f8c-893c-1f8012b18be3 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:29.501443 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-0c217ead-c72a-4f8c-893c-1f8012b18be3 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:29.507160 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a35099b7-1483-48d8-b0a0-96538fb44d1f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:29.507616 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a35099b7-1483-48d8-b0a0-96538fb44d1f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:29.508435 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a35099b7-1483-48d8-b0a0-96538fb44d1f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:29.508878 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a35099b7-1483-48d8-b0a0-96538fb44d1f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:29.607394 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-0c217ead-c72a-4f8c-893c-1f8012b18be3 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28701 microversion: 2.1 time: 0.119527 May 27 03:43:29.608137 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 198/439] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:43:29 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28701 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:43:29.639101 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-a35099b7-1483-48d8-b0a0-96538fb44d1f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 28693 microversion: 2.20 time: 0.143660 May 27 03:43:29.639742 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 242/440] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:43:29 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 28693 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 27 03:43:29.746392 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-7c46e6ce-ac09-46ca-9500-6e638c39d90c tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:29.747031 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-7c46e6ce-ac09-46ca-9500-6e638c39d90c tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 7caeff19-8b2a-4c81-b6f2-1178b3f1a561] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:29.754862 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-7c46e6ce-ac09-46ca-9500-6e638c39d90c tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:29.755309 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-7c46e6ce-ac09-46ca-9500-6e638c39d90c tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:29.756070 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-7c46e6ce-ac09-46ca-9500-6e638c39d90c tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:29.756539 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-7c46e6ce-ac09-46ca-9500-6e638c39d90c tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:29.856664 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-4abd411e-fbc0-4e2a-a72e-d2050e739ddc tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:29.857473 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-4abd411e-fbc0-4e2a-a72e-d2050e739ddc tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] [instance: fe309d4b-1169-4574-a57b-7e3c2cc5ddf4] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:29.865411 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4abd411e-fbc0-4e2a-a72e-d2050e739ddc tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:29.865868 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4abd411e-fbc0-4e2a-a72e-d2050e739ddc tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:29.866644 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4abd411e-fbc0-4e2a-a72e-d2050e739ddc tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:29.867078 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4abd411e-fbc0-4e2a-a72e-d2050e739ddc tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:29.958322 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-7c46e6ce-ac09-46ca-9500-6e638c39d90c tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:29.976177 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-7c46e6ce-ac09-46ca-9500-6e638c39d90c tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/7caeff19-8b2a-4c81-b6f2-1178b3f1a561" status: 200 len: 1317 microversion: 2.1 time: 0.233683 May 27 03:43:29.986812 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 199/441] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:29 2021] GET /compute/v2.1/servers/7caeff19-8b2a-4c81-b6f2-1178b3f1a561 => generated 1317 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:30.003456 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-14afa7d7-27cd-4a34-835f-d358c8a3f575 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:30.004473 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-14afa7d7-27cd-4a34-835f-d358c8a3f575 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:30.012645 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-14afa7d7-27cd-4a34-835f-d358c8a3f575 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:30.013111 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-14afa7d7-27cd-4a34-835f-d358c8a3f575 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:30.013899 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-14afa7d7-27cd-4a34-835f-d358c8a3f575 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:30.014476 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-14afa7d7-27cd-4a34-835f-d358c8a3f575 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:30.083273 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-4abd411e-fbc0-4e2a-a72e-d2050e739ddc tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e96f6ace4b43c4b1ef8d989a67ef90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fd883d8bafd4e248467bbb7b0feb0c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:30.091881 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-4abd411e-fbc0-4e2a-a72e-d2050e739ddc tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] 10.222.0.25 "GET /compute/v2.1/servers/fe309d4b-1169-4574-a57b-7e3c2cc5ddf4" status: 200 len: 1313 microversion: 2.1 time: 0.239320 May 27 03:43:30.092651 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 243/442] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:29 2021] GET /compute/v2.1/servers/fe309d4b-1169-4574-a57b-7e3c2cc5ddf4 => generated 1313 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:43:30.219835 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-14afa7d7-27cd-4a34-835f-d358c8a3f575 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:30.228586 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-14afa7d7-27cd-4a34-835f-d358c8a3f575 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0" status: 200 len: 1569 microversion: 2.1 time: 0.236458 May 27 03:43:30.229162 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 200/443] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:29 2021] GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0 => generated 1569 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:30.499750 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [req-c8bd2a6a-b12a-4610-8e20-c8e45550762e req-6e19c747-b687-4b0f-b639-ee3be6b42c97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7caeff19-8b2a-4c81-b6f2-1178b3f1a561", "name": "network-vif-plugged", "status": "completed", "tag": "c4a2f300-3a9c-46a1-a78d-8b27643ba00e"}]} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:30.502823 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:43:30.502823 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: warnings.warn(msg) May 27 03:43:30.511248 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-c8bd2a6a-b12a-4610-8e20-c8e45550762e req-6e19c747-b687-4b0f-b639-ee3be6b42c97 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:30.511666 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-c8bd2a6a-b12a-4610-8e20-c8e45550762e req-6e19c747-b687-4b0f-b639-ee3be6b42c97 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:30.527476 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.compute.server_external_events [req-c8bd2a6a-b12a-4610-8e20-c8e45550762e req-6e19c747-b687-4b0f-b639-ee3be6b42c97 service nova] Creating event network-vif-plugged:c4a2f300-3a9c-46a1-a78d-8b27643ba00e for instance 7caeff19-8b2a-4c81-b6f2-1178b3f1a561 on hv-cinder-79326 May 27 03:43:30.532295 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [req-c8bd2a6a-b12a-4610-8e20-c8e45550762e req-6e19c747-b687-4b0f-b639-ee3be6b42c97 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036123 May 27 03:43:30.534310 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 244/444] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:43:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:43:30.620444 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-64b9cbae-4f4e-4914-bac8-c6320f58db11 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:30.621487 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-64b9cbae-4f4e-4914-bac8-c6320f58db11 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:30.629511 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-64b9cbae-4f4e-4914-bac8-c6320f58db11 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:30.629969 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-64b9cbae-4f4e-4914-bac8-c6320f58db11 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:30.630776 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-64b9cbae-4f4e-4914-bac8-c6320f58db11 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:30.631215 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-64b9cbae-4f4e-4914-bac8-c6320f58db11 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:30.651765 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-b0e0d4d3-e738-4409-84cf-cffb0fe03c11 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:30.652852 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-b0e0d4d3-e738-4409-84cf-cffb0fe03c11 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:30.660378 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b0e0d4d3-e738-4409-84cf-cffb0fe03c11 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:30.660856 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b0e0d4d3-e738-4409-84cf-cffb0fe03c11 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:30.661657 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b0e0d4d3-e738-4409-84cf-cffb0fe03c11 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:30.662090 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b0e0d4d3-e738-4409-84cf-cffb0fe03c11 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:30.756558 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-64b9cbae-4f4e-4914-bac8-c6320f58db11 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28701 microversion: 2.1 time: 0.140884 May 27 03:43:30.760672 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 201/445] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:43:30 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28701 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:43:30.939253 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-b0e0d4d3-e738-4409-84cf-cffb0fe03c11 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 28693 microversion: 2.20 time: 0.291468 May 27 03:43:30.939923 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 245/446] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:43:30 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 28693 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 27 03:43:30.992948 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-511585de-3017-48d8-801c-878e336e94cd tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:30.993681 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-511585de-3017-48d8-801c-878e336e94cd tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 7caeff19-8b2a-4c81-b6f2-1178b3f1a561] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:31.001732 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-511585de-3017-48d8-801c-878e336e94cd tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:31.002163 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-511585de-3017-48d8-801c-878e336e94cd tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:31.002934 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-511585de-3017-48d8-801c-878e336e94cd tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:31.003385 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-511585de-3017-48d8-801c-878e336e94cd tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:31.109029 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-902b3266-6515-42c6-b919-c9ca8d5f8357 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:31.109944 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-902b3266-6515-42c6-b919-c9ca8d5f8357 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] [instance: fe309d4b-1169-4574-a57b-7e3c2cc5ddf4] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:31.123053 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-902b3266-6515-42c6-b919-c9ca8d5f8357 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:31.123345 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-902b3266-6515-42c6-b919-c9ca8d5f8357 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:31.124078 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-902b3266-6515-42c6-b919-c9ca8d5f8357 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:31.124560 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-902b3266-6515-42c6-b919-c9ca8d5f8357 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:31.218292 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-511585de-3017-48d8-801c-878e336e94cd tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:31.226954 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-511585de-3017-48d8-801c-878e336e94cd tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/7caeff19-8b2a-4c81-b6f2-1178b3f1a561" status: 200 len: 1317 microversion: 2.1 time: 0.238189 May 27 03:43:31.227507 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 202/447] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:30 2021] GET /compute/v2.1/servers/7caeff19-8b2a-4c81-b6f2-1178b3f1a561 => generated 1317 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:31.244949 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-be743bc6-1c51-4b45-a835-35b07d93495f tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:31.245557 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-be743bc6-1c51-4b45-a835-35b07d93495f tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:31.252486 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-be743bc6-1c51-4b45-a835-35b07d93495f tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:31.252945 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-be743bc6-1c51-4b45-a835-35b07d93495f tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:31.253712 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-be743bc6-1c51-4b45-a835-35b07d93495f tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:31.254148 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-be743bc6-1c51-4b45-a835-35b07d93495f tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:31.339058 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-902b3266-6515-42c6-b919-c9ca8d5f8357 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e96f6ace4b43c4b1ef8d989a67ef90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fd883d8bafd4e248467bbb7b0feb0c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:31.347945 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-902b3266-6515-42c6-b919-c9ca8d5f8357 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] 10.222.0.25 "GET /compute/v2.1/servers/fe309d4b-1169-4574-a57b-7e3c2cc5ddf4" status: 200 len: 1313 microversion: 2.1 time: 0.243334 May 27 03:43:31.348537 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 246/448] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:31 2021] GET /compute/v2.1/servers/fe309d4b-1169-4574-a57b-7e3c2cc5ddf4 => generated 1313 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:43:31.448182 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-be743bc6-1c51-4b45-a835-35b07d93495f tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:31.457345 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-be743bc6-1c51-4b45-a835-35b07d93495f tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0" status: 200 len: 1569 microversion: 2.1 time: 0.215917 May 27 03:43:31.457905 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 203/449] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:31 2021] GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0 => generated 1569 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:43:31.768921 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-937815b9-2956-4ce4-82f2-8d54f3e03f88 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:31.769887 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-937815b9-2956-4ce4-82f2-8d54f3e03f88 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:31.777169 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-937815b9-2956-4ce4-82f2-8d54f3e03f88 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:31.777630 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-937815b9-2956-4ce4-82f2-8d54f3e03f88 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:31.778440 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-937815b9-2956-4ce4-82f2-8d54f3e03f88 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:31.778885 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-937815b9-2956-4ce4-82f2-8d54f3e03f88 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:31.909758 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-937815b9-2956-4ce4-82f2-8d54f3e03f88 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28701 microversion: 2.1 time: 0.145031 May 27 03:43:31.910390 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 247/450] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:43:31 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28701 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:43:31.950710 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-16bcd9fb-e0ca-447e-b026-4fac8ce26258 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:31.951638 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-16bcd9fb-e0ca-447e-b026-4fac8ce26258 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:31.958847 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-16bcd9fb-e0ca-447e-b026-4fac8ce26258 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:31.959299 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-16bcd9fb-e0ca-447e-b026-4fac8ce26258 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:31.960067 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-16bcd9fb-e0ca-447e-b026-4fac8ce26258 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:31.960528 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-16bcd9fb-e0ca-447e-b026-4fac8ce26258 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:32.196124 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-16bcd9fb-e0ca-447e-b026-4fac8ce26258 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 28693 microversion: 2.20 time: 0.248855 May 27 03:43:32.196789 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 204/451] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:43:31 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 28693 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:43:32.243650 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-2be1d47c-02e9-467a-976c-c13282c92d58 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:32.244355 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-2be1d47c-02e9-467a-976c-c13282c92d58 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 7caeff19-8b2a-4c81-b6f2-1178b3f1a561] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:32.252195 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-2be1d47c-02e9-467a-976c-c13282c92d58 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:32.252692 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-2be1d47c-02e9-467a-976c-c13282c92d58 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:32.253474 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-2be1d47c-02e9-467a-976c-c13282c92d58 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:32.253919 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-2be1d47c-02e9-467a-976c-c13282c92d58 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:32.365602 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-f34aeaf9-1cec-4a6d-8955-12b3d19fd689 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:32.366290 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-f34aeaf9-1cec-4a6d-8955-12b3d19fd689 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] [instance: fe309d4b-1169-4574-a57b-7e3c2cc5ddf4] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:32.374297 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f34aeaf9-1cec-4a6d-8955-12b3d19fd689 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:32.374764 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f34aeaf9-1cec-4a6d-8955-12b3d19fd689 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:32.375586 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f34aeaf9-1cec-4a6d-8955-12b3d19fd689 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:32.376053 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f34aeaf9-1cec-4a6d-8955-12b3d19fd689 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:32.458974 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-2be1d47c-02e9-467a-976c-c13282c92d58 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:32.467145 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-2be1d47c-02e9-467a-976c-c13282c92d58 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/7caeff19-8b2a-4c81-b6f2-1178b3f1a561" status: 200 len: 1317 microversion: 2.1 time: 0.227555 May 27 03:43:32.467702 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 248/452] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:32 2021] GET /compute/v2.1/servers/7caeff19-8b2a-4c81-b6f2-1178b3f1a561 => generated 1317 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:32.474455 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-51d7690a-d5fd-4a8e-a6e2-7dd3240fcb25 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:32.475143 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-51d7690a-d5fd-4a8e-a6e2-7dd3240fcb25 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:32.482492 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-51d7690a-d5fd-4a8e-a6e2-7dd3240fcb25 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:32.482937 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-51d7690a-d5fd-4a8e-a6e2-7dd3240fcb25 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:32.483698 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-51d7690a-d5fd-4a8e-a6e2-7dd3240fcb25 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:32.484132 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-51d7690a-d5fd-4a8e-a6e2-7dd3240fcb25 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:32.651914 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-f34aeaf9-1cec-4a6d-8955-12b3d19fd689 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e96f6ace4b43c4b1ef8d989a67ef90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fd883d8bafd4e248467bbb7b0feb0c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:32.660761 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-f34aeaf9-1cec-4a6d-8955-12b3d19fd689 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] 10.222.0.25 "GET /compute/v2.1/servers/fe309d4b-1169-4574-a57b-7e3c2cc5ddf4" status: 200 len: 1313 microversion: 2.1 time: 0.299236 May 27 03:43:32.661315 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 205/453] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:32 2021] GET /compute/v2.1/servers/fe309d4b-1169-4574-a57b-7e3c2cc5ddf4 => generated 1313 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:43:32.680514 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-51d7690a-d5fd-4a8e-a6e2-7dd3240fcb25 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:32.689085 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-51d7690a-d5fd-4a8e-a6e2-7dd3240fcb25 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0" status: 200 len: 1569 microversion: 2.1 time: 0.218028 May 27 03:43:32.689722 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 249/454] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:32 2021] GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0 => generated 1569 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:32.921310 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-87d69f94-bd5d-45c8-be61-1f13f984137f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:32.922327 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-87d69f94-bd5d-45c8-be61-1f13f984137f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:32.929456 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-87d69f94-bd5d-45c8-be61-1f13f984137f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:32.929908 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-87d69f94-bd5d-45c8-be61-1f13f984137f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:32.930674 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-87d69f94-bd5d-45c8-be61-1f13f984137f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:32.931109 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-87d69f94-bd5d-45c8-be61-1f13f984137f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:33.031709 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-87d69f94-bd5d-45c8-be61-1f13f984137f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28701 microversion: 2.1 time: 0.113955 May 27 03:43:33.032369 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 206/455] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:43:32 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28701 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 03:43:33.208854 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-f6ec9769-34fa-4bc1-a4ea-b38b08322251 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:33.209795 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-f6ec9769-34fa-4bc1-a4ea-b38b08322251 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:33.217055 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f6ec9769-34fa-4bc1-a4ea-b38b08322251 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:33.217506 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f6ec9769-34fa-4bc1-a4ea-b38b08322251 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:33.218265 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f6ec9769-34fa-4bc1-a4ea-b38b08322251 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:33.218703 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f6ec9769-34fa-4bc1-a4ea-b38b08322251 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:33.322190 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-f6ec9769-34fa-4bc1-a4ea-b38b08322251 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 28693 microversion: 2.20 time: 0.116919 May 27 03:43:33.323639 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 250/456] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:43:33 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 28693 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:43:33.484638 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-f50cf689-c361-4747-aee0-0978948d95e1 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:33.485767 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-f50cf689-c361-4747-aee0-0978948d95e1 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 7caeff19-8b2a-4c81-b6f2-1178b3f1a561] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:33.493639 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f50cf689-c361-4747-aee0-0978948d95e1 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:33.494092 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f50cf689-c361-4747-aee0-0978948d95e1 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:33.494863 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f50cf689-c361-4747-aee0-0978948d95e1 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:33.495303 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f50cf689-c361-4747-aee0-0978948d95e1 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:33.678357 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-4412bb28-66f9-4b6b-801c-22babbdbd3a6 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:33.679215 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-4412bb28-66f9-4b6b-801c-22babbdbd3a6 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] [instance: fe309d4b-1169-4574-a57b-7e3c2cc5ddf4] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:33.687070 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4412bb28-66f9-4b6b-801c-22babbdbd3a6 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:33.687529 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4412bb28-66f9-4b6b-801c-22babbdbd3a6 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:33.688373 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4412bb28-66f9-4b6b-801c-22babbdbd3a6 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:33.689426 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4412bb28-66f9-4b6b-801c-22babbdbd3a6 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:33.692746 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-f50cf689-c361-4747-aee0-0978948d95e1 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:33.701531 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-f50cf689-c361-4747-aee0-0978948d95e1 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/7caeff19-8b2a-4c81-b6f2-1178b3f1a561" status: 200 len: 1317 microversion: 2.1 time: 0.221195 May 27 03:43:33.702098 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 207/457] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:33 2021] GET /compute/v2.1/servers/7caeff19-8b2a-4c81-b6f2-1178b3f1a561 => generated 1317 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:33.706540 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-6a9146df-8acd-4f39-87f1-f53871b55778 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:33.707140 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-6a9146df-8acd-4f39-87f1-f53871b55778 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:33.714029 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6a9146df-8acd-4f39-87f1-f53871b55778 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:33.714477 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6a9146df-8acd-4f39-87f1-f53871b55778 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:33.715264 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6a9146df-8acd-4f39-87f1-f53871b55778 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:33.715868 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6a9146df-8acd-4f39-87f1-f53871b55778 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:33.893741 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-4412bb28-66f9-4b6b-801c-22babbdbd3a6 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e96f6ace4b43c4b1ef8d989a67ef90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fd883d8bafd4e248467bbb7b0feb0c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:33.901861 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-4412bb28-66f9-4b6b-801c-22babbdbd3a6 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] 10.222.0.25 "GET /compute/v2.1/servers/fe309d4b-1169-4574-a57b-7e3c2cc5ddf4" status: 200 len: 1313 microversion: 2.1 time: 0.227603 May 27 03:43:33.902429 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 251/458] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:33 2021] GET /compute/v2.1/servers/fe309d4b-1169-4574-a57b-7e3c2cc5ddf4 => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:43:33.912080 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-6a9146df-8acd-4f39-87f1-f53871b55778 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:33.920859 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-6a9146df-8acd-4f39-87f1-f53871b55778 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0" status: 200 len: 1569 microversion: 2.1 time: 0.217800 May 27 03:43:33.921435 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 208/459] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:33 2021] GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0 => generated 1569 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:34.043306 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-44d78b8b-6bce-4859-8138-6241f75860e8 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:34.044239 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-44d78b8b-6bce-4859-8138-6241f75860e8 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:34.052051 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-44d78b8b-6bce-4859-8138-6241f75860e8 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:34.052542 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-44d78b8b-6bce-4859-8138-6241f75860e8 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:34.053324 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-44d78b8b-6bce-4859-8138-6241f75860e8 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:34.053765 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-44d78b8b-6bce-4859-8138-6241f75860e8 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:34.223665 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [req-f7175cde-c8f1-4fb7-b504-d999adde94d2 req-5d2eb44e-775b-432d-b937-f03f267090c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe309d4b-1169-4574-a57b-7e3c2cc5ddf4", "name": "network-vif-plugged", "status": "completed", "tag": "b0b1cc61-eef3-4210-b550-01a9151eae95"}]} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:34.225337 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:43:34.225337 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: warnings.warn(msg) May 27 03:43:34.233423 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-f7175cde-c8f1-4fb7-b504-d999adde94d2 req-5d2eb44e-775b-432d-b937-f03f267090c3 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:34.233878 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-f7175cde-c8f1-4fb7-b504-d999adde94d2 req-5d2eb44e-775b-432d-b937-f03f267090c3 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:34.249745 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.compute.server_external_events [req-f7175cde-c8f1-4fb7-b504-d999adde94d2 req-5d2eb44e-775b-432d-b937-f03f267090c3 service nova] Creating event network-vif-plugged:b0b1cc61-eef3-4210-b550-01a9151eae95 for instance fe309d4b-1169-4574-a57b-7e3c2cc5ddf4 on hv-cinder-79326 May 27 03:43:34.255109 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [req-f7175cde-c8f1-4fb7-b504-d999adde94d2 req-5d2eb44e-775b-432d-b937-f03f267090c3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037220 May 27 03:43:34.255691 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 209/460] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:43:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:43:34.335373 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-f962e529-3a10-4a76-af33-da6c2f5938b6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:34.336734 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-f962e529-3a10-4a76-af33-da6c2f5938b6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:34.345572 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f962e529-3a10-4a76-af33-da6c2f5938b6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:34.346249 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f962e529-3a10-4a76-af33-da6c2f5938b6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:34.347132 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f962e529-3a10-4a76-af33-da6c2f5938b6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:34.347854 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f962e529-3a10-4a76-af33-da6c2f5938b6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:34.351346 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-44d78b8b-6bce-4859-8138-6241f75860e8 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28701 microversion: 2.1 time: 0.311790 May 27 03:43:34.356612 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 252/461] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:43:34 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28701 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:43:34.473135 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-f962e529-3a10-4a76-af33-da6c2f5938b6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 28693 microversion: 2.20 time: 0.142494 May 27 03:43:34.474754 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 210/462] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:43:34 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 28693 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:43:34.717978 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-f9b7cbf6-85de-46d3-92d7-f10d653029e3 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:34.718598 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-f9b7cbf6-85de-46d3-92d7-f10d653029e3 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 7caeff19-8b2a-4c81-b6f2-1178b3f1a561] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:34.726215 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f9b7cbf6-85de-46d3-92d7-f10d653029e3 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:34.727486 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f9b7cbf6-85de-46d3-92d7-f10d653029e3 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:34.727486 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f9b7cbf6-85de-46d3-92d7-f10d653029e3 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:34.727969 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f9b7cbf6-85de-46d3-92d7-f10d653029e3 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:34.919489 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-436a1449-6fea-4fd8-bf8d-f27a293c8afd tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:34.920198 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-436a1449-6fea-4fd8-bf8d-f27a293c8afd tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] [instance: fe309d4b-1169-4574-a57b-7e3c2cc5ddf4] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:34.924844 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-f9b7cbf6-85de-46d3-92d7-f10d653029e3 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:34.928619 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-436a1449-6fea-4fd8-bf8d-f27a293c8afd tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:34.929082 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-436a1449-6fea-4fd8-bf8d-f27a293c8afd tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:34.929875 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-436a1449-6fea-4fd8-bf8d-f27a293c8afd tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:34.930322 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-436a1449-6fea-4fd8-bf8d-f27a293c8afd tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:34.933315 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-f9b7cbf6-85de-46d3-92d7-f10d653029e3 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/7caeff19-8b2a-4c81-b6f2-1178b3f1a561" status: 200 len: 1507 microversion: 2.1 time: 0.219671 May 27 03:43:34.933887 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 253/463] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:34 2021] GET /compute/v2.1/servers/7caeff19-8b2a-4c81-b6f2-1178b3f1a561 => generated 1507 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:34.938201 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-2b977bcc-0211-4d0b-90cf-cc1dea6204ee tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:34.939454 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-2b977bcc-0211-4d0b-90cf-cc1dea6204ee tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:34.951062 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-2b977bcc-0211-4d0b-90cf-cc1dea6204ee tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:34.951516 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-2b977bcc-0211-4d0b-90cf-cc1dea6204ee tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:34.952287 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-2b977bcc-0211-4d0b-90cf-cc1dea6204ee tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:34.952746 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-2b977bcc-0211-4d0b-90cf-cc1dea6204ee tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:35.139660 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-436a1449-6fea-4fd8-bf8d-f27a293c8afd tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e96f6ace4b43c4b1ef8d989a67ef90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fd883d8bafd4e248467bbb7b0feb0c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:35.149306 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-436a1449-6fea-4fd8-bf8d-f27a293c8afd tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] 10.222.0.25 "GET /compute/v2.1/servers/fe309d4b-1169-4574-a57b-7e3c2cc5ddf4" status: 200 len: 1313 microversion: 2.1 time: 0.234042 May 27 03:43:35.158258 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 211/464] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:34 2021] GET /compute/v2.1/servers/fe309d4b-1169-4574-a57b-7e3c2cc5ddf4 => generated 1313 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:43:35.170312 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-2b977bcc-0211-4d0b-90cf-cc1dea6204ee tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:35.179515 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-2b977bcc-0211-4d0b-90cf-cc1dea6204ee tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0" status: 200 len: 1569 microversion: 2.1 time: 0.244691 May 27 03:43:35.180054 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 254/465] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:34 2021] GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0 => generated 1569 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:35.362829 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-b5a9fcd3-daab-4a26-91b9-8b6bc3fc62ec tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:35.363902 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-b5a9fcd3-daab-4a26-91b9-8b6bc3fc62ec tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:35.371097 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b5a9fcd3-daab-4a26-91b9-8b6bc3fc62ec tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:35.371571 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b5a9fcd3-daab-4a26-91b9-8b6bc3fc62ec tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:35.372334 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b5a9fcd3-daab-4a26-91b9-8b6bc3fc62ec tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:35.372802 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b5a9fcd3-daab-4a26-91b9-8b6bc3fc62ec tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:35.486155 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-f8fe4a3e-bcbf-419d-9077-0f1944f5f017 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:35.487214 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-f8fe4a3e-bcbf-419d-9077-0f1944f5f017 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:35.506491 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f8fe4a3e-bcbf-419d-9077-0f1944f5f017 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:35.506953 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f8fe4a3e-bcbf-419d-9077-0f1944f5f017 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:35.507743 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f8fe4a3e-bcbf-419d-9077-0f1944f5f017 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:35.508185 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f8fe4a3e-bcbf-419d-9077-0f1944f5f017 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:35.510152 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-b5a9fcd3-daab-4a26-91b9-8b6bc3fc62ec tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28701 microversion: 2.1 time: 0.150843 May 27 03:43:35.511699 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 212/466] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:43:35 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28701 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:43:35.724837 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-f8fe4a3e-bcbf-419d-9077-0f1944f5f017 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 28693 microversion: 2.20 time: 0.243373 May 27 03:43:35.725597 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 255/467] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:43:35 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 28693 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 27 03:43:36.166242 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-d8f60e47-acd7-4adb-95cf-5bd450d792f7 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:36.166985 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-d8f60e47-acd7-4adb-95cf-5bd450d792f7 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] [instance: fe309d4b-1169-4574-a57b-7e3c2cc5ddf4] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:36.174918 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d8f60e47-acd7-4adb-95cf-5bd450d792f7 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:36.175380 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d8f60e47-acd7-4adb-95cf-5bd450d792f7 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:36.176159 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d8f60e47-acd7-4adb-95cf-5bd450d792f7 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:36.176639 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d8f60e47-acd7-4adb-95cf-5bd450d792f7 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:36.197502 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-020e028b-d5a1-4798-895e-3f2d0891854b tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:36.198409 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-020e028b-d5a1-4798-895e-3f2d0891854b tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:36.206800 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-020e028b-d5a1-4798-895e-3f2d0891854b tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:36.207252 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-020e028b-d5a1-4798-895e-3f2d0891854b tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:36.208025 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-020e028b-d5a1-4798-895e-3f2d0891854b tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:36.208479 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-020e028b-d5a1-4798-895e-3f2d0891854b tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:36.377608 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-d8f60e47-acd7-4adb-95cf-5bd450d792f7 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e96f6ace4b43c4b1ef8d989a67ef90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fd883d8bafd4e248467bbb7b0feb0c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:36.386130 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-d8f60e47-acd7-4adb-95cf-5bd450d792f7 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] 10.222.0.25 "GET /compute/v2.1/servers/fe309d4b-1169-4574-a57b-7e3c2cc5ddf4" status: 200 len: 1313 microversion: 2.1 time: 0.224221 May 27 03:43:36.386704 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 213/468] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:36 2021] GET /compute/v2.1/servers/fe309d4b-1169-4574-a57b-7e3c2cc5ddf4 => generated 1313 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:36.408795 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-020e028b-d5a1-4798-895e-3f2d0891854b tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:36.418253 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-020e028b-d5a1-4798-895e-3f2d0891854b tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0" status: 200 len: 1569 microversion: 2.1 time: 0.224762 May 27 03:43:36.418745 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 256/469] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:36 2021] GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0 => generated 1569 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:43:36.521651 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-fb61a806-9757-425b-9857-0dc12eedc765 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:36.522581 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-fb61a806-9757-425b-9857-0dc12eedc765 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:36.530751 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-fb61a806-9757-425b-9857-0dc12eedc765 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:36.531206 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-fb61a806-9757-425b-9857-0dc12eedc765 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:36.531986 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-fb61a806-9757-425b-9857-0dc12eedc765 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:36.532470 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-fb61a806-9757-425b-9857-0dc12eedc765 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:36.677291 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-fb61a806-9757-425b-9857-0dc12eedc765 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28701 microversion: 2.1 time: 0.159200 May 27 03:43:36.677932 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 214/470] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:43:36 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28701 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:43:36.737179 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-32f8689a-44e3-4349-847f-1ef8137fe130 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:36.738094 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-32f8689a-44e3-4349-847f-1ef8137fe130 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:36.745411 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-32f8689a-44e3-4349-847f-1ef8137fe130 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:36.745946 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-32f8689a-44e3-4349-847f-1ef8137fe130 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:36.746827 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-32f8689a-44e3-4349-847f-1ef8137fe130 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:36.747262 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-32f8689a-44e3-4349-847f-1ef8137fe130 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:36.935160 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-32f8689a-44e3-4349-847f-1ef8137fe130 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 28693 microversion: 2.20 time: 0.202072 May 27 03:43:36.935753 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 257/471] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:43:36 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 28693 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 27 03:43:37.403709 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-d1c51a44-978e-40b7-b706-6ff1e24f6f21 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:37.404445 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-d1c51a44-978e-40b7-b706-6ff1e24f6f21 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] [instance: fe309d4b-1169-4574-a57b-7e3c2cc5ddf4] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:37.413029 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d1c51a44-978e-40b7-b706-6ff1e24f6f21 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:37.413479 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d1c51a44-978e-40b7-b706-6ff1e24f6f21 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:37.414242 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d1c51a44-978e-40b7-b706-6ff1e24f6f21 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:37.414675 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d1c51a44-978e-40b7-b706-6ff1e24f6f21 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:37.435274 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-4fbe9077-767a-4968-8a71-3a265e625203 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:37.436004 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-4fbe9077-767a-4968-8a71-3a265e625203 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:37.443551 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4fbe9077-767a-4968-8a71-3a265e625203 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:37.443998 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4fbe9077-767a-4968-8a71-3a265e625203 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:37.445389 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4fbe9077-767a-4968-8a71-3a265e625203 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:37.445954 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4fbe9077-767a-4968-8a71-3a265e625203 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:37.616438 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-d1c51a44-978e-40b7-b706-6ff1e24f6f21 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e96f6ace4b43c4b1ef8d989a67ef90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fd883d8bafd4e248467bbb7b0feb0c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:37.625356 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-d1c51a44-978e-40b7-b706-6ff1e24f6f21 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] 10.222.0.25 "GET /compute/v2.1/servers/fe309d4b-1169-4574-a57b-7e3c2cc5ddf4" status: 200 len: 1462 microversion: 2.1 time: 0.225951 May 27 03:43:37.637034 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 215/472] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:37 2021] GET /compute/v2.1/servers/fe309d4b-1169-4574-a57b-7e3c2cc5ddf4 => generated 1462 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:43:37.690944 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-698406f1-fb63-4305-a21f-bf98df179b37 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:37.692819 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-698406f1-fb63-4305-a21f-bf98df179b37 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:37.703405 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-698406f1-fb63-4305-a21f-bf98df179b37 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:37.704644 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-698406f1-fb63-4305-a21f-bf98df179b37 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:37.705534 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-698406f1-fb63-4305-a21f-bf98df179b37 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:37.706057 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-698406f1-fb63-4305-a21f-bf98df179b37 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:37.727361 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-4fbe9077-767a-4968-8a71-3a265e625203 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:37.736853 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-4fbe9077-767a-4968-8a71-3a265e625203 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0" status: 200 len: 1569 microversion: 2.1 time: 0.305651 May 27 03:43:37.737410 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 258/473] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:37 2021] GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0 => generated 1569 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:43:37.742675 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-429acb84-ad45-4266-bce4-709a37683d5c tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:37.743369 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-429acb84-ad45-4266-bce4-709a37683d5c tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] [instance: fe309d4b-1169-4574-a57b-7e3c2cc5ddf4] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:37.751077 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-429acb84-ad45-4266-bce4-709a37683d5c tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:37.751649 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-429acb84-ad45-4266-bce4-709a37683d5c tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:37.752479 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-429acb84-ad45-4266-bce4-709a37683d5c tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:37.753025 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-429acb84-ad45-4266-bce4-709a37683d5c tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:37.808580 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-698406f1-fb63-4305-a21f-bf98df179b37 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28701 microversion: 2.1 time: 0.122804 May 27 03:43:37.810226 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 216/474] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:43:37 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28701 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:43:37.813711 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-429acb84-ad45-4266-bce4-709a37683d5c tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] [instance: fe309d4b-1169-4574-a57b-7e3c2cc5ddf4] Going to try to terminate instance {{(pid=113020) delete /opt/stack/nova/nova/compute/api.py:2539}} May 27 03:43:37.946768 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-aa65cc90-8113-474b-a51f-8cde35115444 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:37.947781 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-aa65cc90-8113-474b-a51f-8cde35115444 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:37.955659 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-aa65cc90-8113-474b-a51f-8cde35115444 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:37.960460 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-aa65cc90-8113-474b-a51f-8cde35115444 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:37.960460 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-aa65cc90-8113-474b-a51f-8cde35115444 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:37.960460 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-aa65cc90-8113-474b-a51f-8cde35115444 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:38.130307 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-aa65cc90-8113-474b-a51f-8cde35115444 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 28693 microversion: 2.20 time: 0.187369 May 27 03:43:38.130869 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 217/475] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:43:37 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 28693 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 27 03:43:38.163134 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-429acb84-ad45-4266-bce4-709a37683d5c tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] 10.222.0.25 "DELETE /compute/v2.1/servers/fe309d4b-1169-4574-a57b-7e3c2cc5ddf4" status: 204 len: 0 microversion: 2.1 time: 0.423840 May 27 03:43:38.163702 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 259/476] 10.222.0.25 () {58 vars in 1239 bytes} [Thu May 27 03:43:37 2021] DELETE /compute/v2.1/servers/fe309d4b-1169-4574-a57b-7e3c2cc5ddf4 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 03:43:38.172364 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-fa2e0e5c-6ef0-482a-8d3b-a443d706702c tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:38.173555 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-fa2e0e5c-6ef0-482a-8d3b-a443d706702c tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] [instance: fe309d4b-1169-4574-a57b-7e3c2cc5ddf4] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:38.181492 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-fa2e0e5c-6ef0-482a-8d3b-a443d706702c tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:38.181949 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-fa2e0e5c-6ef0-482a-8d3b-a443d706702c tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:38.182729 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-fa2e0e5c-6ef0-482a-8d3b-a443d706702c tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:38.183171 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-fa2e0e5c-6ef0-482a-8d3b-a443d706702c tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:38.381955 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-fa2e0e5c-6ef0-482a-8d3b-a443d706702c tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e96f6ace4b43c4b1ef8d989a67ef90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fd883d8bafd4e248467bbb7b0feb0c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:38.390315 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-fa2e0e5c-6ef0-482a-8d3b-a443d706702c tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] 10.222.0.25 "GET /compute/v2.1/servers/fe309d4b-1169-4574-a57b-7e3c2cc5ddf4" status: 200 len: 1468 microversion: 2.1 time: 0.221998 May 27 03:43:38.390880 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 218/477] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:38 2021] GET /compute/v2.1/servers/fe309d4b-1169-4574-a57b-7e3c2cc5ddf4 => generated 1468 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:38.753955 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-1bb48e75-8f94-46d6-90a2-4912c6619561 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:38.754657 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-1bb48e75-8f94-46d6-90a2-4912c6619561 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:38.762199 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1bb48e75-8f94-46d6-90a2-4912c6619561 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:38.762652 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1bb48e75-8f94-46d6-90a2-4912c6619561 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:38.763417 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1bb48e75-8f94-46d6-90a2-4912c6619561 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:38.763855 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1bb48e75-8f94-46d6-90a2-4912c6619561 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:38.820438 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-62bca2f1-5f4a-4659-9d92-2d6399f07bd8 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:38.821233 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-62bca2f1-5f4a-4659-9d92-2d6399f07bd8 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:38.830069 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-62bca2f1-5f4a-4659-9d92-2d6399f07bd8 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:38.830612 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-62bca2f1-5f4a-4659-9d92-2d6399f07bd8 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:38.831492 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-62bca2f1-5f4a-4659-9d92-2d6399f07bd8 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:38.832006 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-62bca2f1-5f4a-4659-9d92-2d6399f07bd8 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:38.936049 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-62bca2f1-5f4a-4659-9d92-2d6399f07bd8 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28701 microversion: 2.1 time: 0.119665 May 27 03:43:38.937321 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 219/478] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:43:38 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28701 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 03:43:38.941826 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-7d013e0a-67c9-47a7-8107-b0bdd1b13fee tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "50fd06d4-dc70-4cd8-8684-ee2a5fb942ae"}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:38.942977 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-7d013e0a-67c9-47a7-8107-b0bdd1b13fee tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 7caeff19-8b2a-4c81-b6f2-1178b3f1a561] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:38.950940 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-7d013e0a-67c9-47a7-8107-b0bdd1b13fee tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:38.951398 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-7d013e0a-67c9-47a7-8107-b0bdd1b13fee tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:38.952180 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-7d013e0a-67c9-47a7-8107-b0bdd1b13fee tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:38.952664 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-7d013e0a-67c9-47a7-8107-b0bdd1b13fee tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:38.985907 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-1bb48e75-8f94-46d6-90a2-4912c6619561 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:38.994415 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-1bb48e75-8f94-46d6-90a2-4912c6619561 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0" status: 200 len: 1569 microversion: 2.1 time: 0.244547 May 27 03:43:38.994966 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 260/479] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:38 2021] GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0 => generated 1569 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:39.141130 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-0eec5136-9228-4ad6-84b2-507935a731d2 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:39.142637 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-0eec5136-9228-4ad6-84b2-507935a731d2 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:39.149943 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0eec5136-9228-4ad6-84b2-507935a731d2 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:39.150395 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0eec5136-9228-4ad6-84b2-507935a731d2 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:39.151169 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0eec5136-9228-4ad6-84b2-507935a731d2 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:39.151608 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0eec5136-9228-4ad6-84b2-507935a731d2 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:39.254856 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-0eec5136-9228-4ad6-84b2-507935a731d2 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 28693 microversion: 2.20 time: 0.117255 May 27 03:43:39.267442 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 261/480] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:43:39 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 28693 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 27 03:43:39.407445 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-c0b80a23-e99f-4a0d-802e-1a8078f83780 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:39.408149 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-c0b80a23-e99f-4a0d-802e-1a8078f83780 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] [instance: fe309d4b-1169-4574-a57b-7e3c2cc5ddf4] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:39.416563 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c0b80a23-e99f-4a0d-802e-1a8078f83780 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:39.417014 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c0b80a23-e99f-4a0d-802e-1a8078f83780 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:39.417835 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c0b80a23-e99f-4a0d-802e-1a8078f83780 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:39.418265 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c0b80a23-e99f-4a0d-802e-1a8078f83780 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:39.622576 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-c0b80a23-e99f-4a0d-802e-1a8078f83780 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e96f6ace4b43c4b1ef8d989a67ef90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fd883d8bafd4e248467bbb7b0feb0c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:39.631463 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-c0b80a23-e99f-4a0d-802e-1a8078f83780 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] 10.222.0.25 "GET /compute/v2.1/servers/fe309d4b-1169-4574-a57b-7e3c2cc5ddf4" status: 200 len: 1468 microversion: 2.1 time: 0.228084 May 27 03:43:39.632061 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 262/481] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:39 2021] GET /compute/v2.1/servers/fe309d4b-1169-4574-a57b-7e3c2cc5ddf4 => generated 1468 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:43:39.820384 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-7d013e0a-67c9-47a7-8107-b0bdd1b13fee tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "POST /compute/v2.1/servers/7caeff19-8b2a-4c81-b6f2-1178b3f1a561/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.881874 May 27 03:43:39.820704 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 220/482] 10.222.0.25 () {60 vars in 1323 bytes} [Thu May 27 03:43:38 2021] POST /compute/v2.1/servers/7caeff19-8b2a-4c81-b6f2-1178b3f1a561/os-volume_attachments => generated 194 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:43:39.947114 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-fb09e0ee-f079-49f9-bcc5-fd183b6bc5ce tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:39.948037 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-fb09e0ee-f079-49f9-bcc5-fd183b6bc5ce tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:39.955344 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-fb09e0ee-f079-49f9-bcc5-fd183b6bc5ce tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:39.955810 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-fb09e0ee-f079-49f9-bcc5-fd183b6bc5ce tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:39.956592 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-fb09e0ee-f079-49f9-bcc5-fd183b6bc5ce tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:39.957027 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-fb09e0ee-f079-49f9-bcc5-fd183b6bc5ce tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:40.013867 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-cd64d64d-a935-4f75-aaef-e9b53407d6a4 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:40.015723 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-cd64d64d-a935-4f75-aaef-e9b53407d6a4 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:40.023773 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-cd64d64d-a935-4f75-aaef-e9b53407d6a4 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:40.024265 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-cd64d64d-a935-4f75-aaef-e9b53407d6a4 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:40.025369 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-cd64d64d-a935-4f75-aaef-e9b53407d6a4 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:40.025825 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-cd64d64d-a935-4f75-aaef-e9b53407d6a4 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:40.228579 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-cd64d64d-a935-4f75-aaef-e9b53407d6a4 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:40.237262 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-cd64d64d-a935-4f75-aaef-e9b53407d6a4 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0" status: 200 len: 1569 microversion: 2.1 time: 0.229865 May 27 03:43:40.237824 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 221/483] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:40 2021] GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0 => generated 1569 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:43:40.265127 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-4177f9f8-fd43-4317-8c1e-0f45f5c062f8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:40.266607 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-4177f9f8-fd43-4317-8c1e-0f45f5c062f8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:40.274081 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-4177f9f8-fd43-4317-8c1e-0f45f5c062f8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:40.274532 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-4177f9f8-fd43-4317-8c1e-0f45f5c062f8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:40.275299 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-4177f9f8-fd43-4317-8c1e-0f45f5c062f8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:40.275734 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-4177f9f8-fd43-4317-8c1e-0f45f5c062f8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:40.357016 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-fb09e0ee-f079-49f9-bcc5-fd183b6bc5ce tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28701 microversion: 2.1 time: 0.413341 May 27 03:43:40.357616 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 263/484] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:43:39 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28701 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:43:40.511431 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-4177f9f8-fd43-4317-8c1e-0f45f5c062f8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 28693 microversion: 2.20 time: 0.249460 May 27 03:43:40.515409 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 222/485] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:43:40 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 28693 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 27 03:43:40.649076 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-a8aa47b1-78d5-4c3e-9222-24248644ef3c tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:40.649781 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-a8aa47b1-78d5-4c3e-9222-24248644ef3c tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] [instance: fe309d4b-1169-4574-a57b-7e3c2cc5ddf4] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:40.657462 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a8aa47b1-78d5-4c3e-9222-24248644ef3c tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:40.657917 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a8aa47b1-78d5-4c3e-9222-24248644ef3c tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:40.658691 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a8aa47b1-78d5-4c3e-9222-24248644ef3c tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:40.659128 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a8aa47b1-78d5-4c3e-9222-24248644ef3c tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:40.859638 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-a8aa47b1-78d5-4c3e-9222-24248644ef3c tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e96f6ace4b43c4b1ef8d989a67ef90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fd883d8bafd4e248467bbb7b0feb0c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:40.868798 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-a8aa47b1-78d5-4c3e-9222-24248644ef3c tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] 10.222.0.25 "GET /compute/v2.1/servers/fe309d4b-1169-4574-a57b-7e3c2cc5ddf4" status: 200 len: 1468 microversion: 2.1 time: 0.223674 May 27 03:43:40.869372 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 264/486] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:40 2021] GET /compute/v2.1/servers/fe309d4b-1169-4574-a57b-7e3c2cc5ddf4 => generated 1468 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:41.247111 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [req-e7b3cf47-50bf-4a9d-88c5-1744e167d0ff req-bd48fe58-2942-4f43-8dfc-0326f215fafe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe309d4b-1169-4574-a57b-7e3c2cc5ddf4", "name": "network-vif-deleted", "tag": "b0b1cc61-eef3-4210-b550-01a9151eae95"}]} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:41.249366 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:43:41.249366 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: warnings.warn(msg) May 27 03:43:41.253957 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-290ae545-109b-45c6-9f79-44d4f6050cf3 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:41.254564 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-290ae545-109b-45c6-9f79-44d4f6050cf3 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:41.259195 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-e7b3cf47-50bf-4a9d-88c5-1744e167d0ff req-bd48fe58-2942-4f43-8dfc-0326f215fafe service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:41.261976 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-e7b3cf47-50bf-4a9d-88c5-1744e167d0ff req-bd48fe58-2942-4f43-8dfc-0326f215fafe service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:41.262089 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-290ae545-109b-45c6-9f79-44d4f6050cf3 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:41.262449 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-290ae545-109b-45c6-9f79-44d4f6050cf3 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:41.263232 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-290ae545-109b-45c6-9f79-44d4f6050cf3 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:41.263676 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-290ae545-109b-45c6-9f79-44d4f6050cf3 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:41.278059 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.compute.server_external_events [req-e7b3cf47-50bf-4a9d-88c5-1744e167d0ff req-bd48fe58-2942-4f43-8dfc-0326f215fafe service nova] Creating event network-vif-deleted:b0b1cc61-eef3-4210-b550-01a9151eae95 for instance fe309d4b-1169-4574-a57b-7e3c2cc5ddf4 on hv-cinder-79326 May 27 03:43:41.283812 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [req-e7b3cf47-50bf-4a9d-88c5-1744e167d0ff req-bd48fe58-2942-4f43-8dfc-0326f215fafe service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040772 May 27 03:43:41.284892 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 223/487] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:43:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:43:41.374319 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-3adcb0a6-f213-4c75-9e4f-d34d97d52c70 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:41.375370 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-3adcb0a6-f213-4c75-9e4f-d34d97d52c70 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:41.383440 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-3adcb0a6-f213-4c75-9e4f-d34d97d52c70 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:41.383898 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-3adcb0a6-f213-4c75-9e4f-d34d97d52c70 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:41.384717 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-3adcb0a6-f213-4c75-9e4f-d34d97d52c70 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:41.385165 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-3adcb0a6-f213-4c75-9e4f-d34d97d52c70 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:41.470125 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-290ae545-109b-45c6-9f79-44d4f6050cf3 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:41.479500 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-290ae545-109b-45c6-9f79-44d4f6050cf3 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0" status: 200 len: 1569 microversion: 2.1 time: 0.229208 May 27 03:43:41.480074 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 265/488] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:41 2021] GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0 => generated 1569 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:43:41.493436 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-3adcb0a6-f213-4c75-9e4f-d34d97d52c70 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28701 microversion: 2.1 time: 0.123155 May 27 03:43:41.494267 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 224/489] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:43:41 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28701 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:43:41.523053 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-8dc15d8b-807b-43cf-8ea4-f88fe5e7068f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:41.523978 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-8dc15d8b-807b-43cf-8ea4-f88fe5e7068f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:41.531216 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8dc15d8b-807b-43cf-8ea4-f88fe5e7068f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:41.531669 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8dc15d8b-807b-43cf-8ea4-f88fe5e7068f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:41.533014 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8dc15d8b-807b-43cf-8ea4-f88fe5e7068f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:41.533460 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8dc15d8b-807b-43cf-8ea4-f88fe5e7068f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:41.633556 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-8dc15d8b-807b-43cf-8ea4-f88fe5e7068f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 28693 microversion: 2.20 time: 0.113980 May 27 03:43:41.637513 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 266/490] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:43:41 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 28693 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 27 03:43:41.887001 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-780dd57e-e10f-42fe-ada7-763ce2aca705 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:41.887739 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-780dd57e-e10f-42fe-ada7-763ce2aca705 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] [instance: fe309d4b-1169-4574-a57b-7e3c2cc5ddf4] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:41.897167 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-780dd57e-e10f-42fe-ada7-763ce2aca705 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:41.897624 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-780dd57e-e10f-42fe-ada7-763ce2aca705 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:41.898403 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-780dd57e-e10f-42fe-ada7-763ce2aca705 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:41.898843 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-780dd57e-e10f-42fe-ada7-763ce2aca705 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:41.967980 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-780dd57e-e10f-42fe-ada7-763ce2aca705 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:41.968351 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-780dd57e-e10f-42fe-ada7-763ce2aca705 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:41.968828 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.objects.instance [None req-780dd57e-e10f-42fe-ada7-763ce2aca705 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lazy-loading 'fault' on Instance uuid fe309d4b-1169-4574-a57b-7e3c2cc5ddf4 {{(pid=113021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 27 03:43:42.104674 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-780dd57e-e10f-42fe-ada7-763ce2aca705 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95e96f6ace4b43c4b1ef8d989a67ef90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fd883d8bafd4e248467bbb7b0feb0c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:42.112848 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-780dd57e-e10f-42fe-ada7-763ce2aca705 tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] 10.222.0.25 "GET /compute/v2.1/servers/fe309d4b-1169-4574-a57b-7e3c2cc5ddf4" status: 200 len: 1303 microversion: 2.1 time: 0.229969 May 27 03:43:42.113409 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 225/491] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:41 2021] GET /compute/v2.1/servers/fe309d4b-1169-4574-a57b-7e3c2cc5ddf4 => generated 1303 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:42.497405 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-6e3e052b-5818-4aa7-a93b-2f47cc71be39 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:42.498097 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-6e3e052b-5818-4aa7-a93b-2f47cc71be39 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:42.505652 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-447918d7-2f57-4676-9cbd-ada2f4944ab5 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:42.506545 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-447918d7-2f57-4676-9cbd-ada2f4944ab5 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:42.506679 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6e3e052b-5818-4aa7-a93b-2f47cc71be39 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:42.507131 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6e3e052b-5818-4aa7-a93b-2f47cc71be39 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:42.507904 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6e3e052b-5818-4aa7-a93b-2f47cc71be39 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:42.508354 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6e3e052b-5818-4aa7-a93b-2f47cc71be39 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:42.513646 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-447918d7-2f57-4676-9cbd-ada2f4944ab5 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:42.514101 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-447918d7-2f57-4676-9cbd-ada2f4944ab5 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:42.514931 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-447918d7-2f57-4676-9cbd-ada2f4944ab5 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:42.515373 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-447918d7-2f57-4676-9cbd-ada2f4944ab5 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:42.705375 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-6e3e052b-5818-4aa7-a93b-2f47cc71be39 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:42.714445 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-6e3e052b-5818-4aa7-a93b-2f47cc71be39 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0" status: 200 len: 1569 microversion: 2.1 time: 0.221076 May 27 03:43:42.715035 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 267/492] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:42 2021] GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0 => generated 1569 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:42.720316 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-b33c2c49-4114-464a-8150-01403390dc0c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:42.721277 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-b33c2c49-4114-464a-8150-01403390dc0c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:42.728623 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b33c2c49-4114-464a-8150-01403390dc0c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:42.729075 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b33c2c49-4114-464a-8150-01403390dc0c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:42.729846 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b33c2c49-4114-464a-8150-01403390dc0c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:42.730310 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b33c2c49-4114-464a-8150-01403390dc0c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:42.756452 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-447918d7-2f57-4676-9cbd-ada2f4944ab5 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28701 microversion: 2.1 time: 0.254228 May 27 03:43:42.757943 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 226/493] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:43:42 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28701 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 03:43:42.968179 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-b33c2c49-4114-464a-8150-01403390dc0c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 28693 microversion: 2.20 time: 0.251825 May 27 03:43:42.969725 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 268/494] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:43:42 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 28693 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:43:43.136170 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-38740b5e-8d54-4f2d-9dd7-5095af0d349c tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:43.137142 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-38740b5e-8d54-4f2d-9dd7-5095af0d349c tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] [instance: fe309d4b-1169-4574-a57b-7e3c2cc5ddf4] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:43.146664 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-38740b5e-8d54-4f2d-9dd7-5095af0d349c tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:43.147429 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-38740b5e-8d54-4f2d-9dd7-5095af0d349c tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:43.148620 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-38740b5e-8d54-4f2d-9dd7-5095af0d349c tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:43.149128 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-38740b5e-8d54-4f2d-9dd7-5095af0d349c tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:43.204380 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.wsgi [None req-38740b5e-8d54-4f2d-9dd7-5095af0d349c tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] HTTP exception thrown: Instance fe309d4b-1169-4574-a57b-7e3c2cc5ddf4 could not be found. May 27 03:43:43.204969 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-38740b5e-8d54-4f2d-9dd7-5095af0d349c tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] Returning 404 to user: Instance fe309d4b-1169-4574-a57b-7e3c2cc5ddf4 could not be found. {{(pid=113021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 27 03:43:43.205839 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-38740b5e-8d54-4f2d-9dd7-5095af0d349c tempest-VolumesNegativeTest-41913782 tempest-VolumesNegativeTest-41913782-project] 10.222.0.25 "GET /compute/v2.1/servers/fe309d4b-1169-4574-a57b-7e3c2cc5ddf4" status: 404 len: 111 microversion: 2.1 time: 0.074251 May 27 03:43:43.206760 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 227/495] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:43 2021] GET /compute/v2.1/servers/fe309d4b-1169-4574-a57b-7e3c2cc5ddf4 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:43:43.731555 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-6218fc75-9951-4b75-aeb4-b5beced932f7 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:43.732264 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-6218fc75-9951-4b75-aeb4-b5beced932f7 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:43.740527 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6218fc75-9951-4b75-aeb4-b5beced932f7 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:43.740934 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6218fc75-9951-4b75-aeb4-b5beced932f7 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:43.741715 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6218fc75-9951-4b75-aeb4-b5beced932f7 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:43.742154 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6218fc75-9951-4b75-aeb4-b5beced932f7 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:43.768866 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-a23ee310-07c1-45f1-86a7-f0c048d8bfe0 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:43.769796 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-a23ee310-07c1-45f1-86a7-f0c048d8bfe0 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:43.777723 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a23ee310-07c1-45f1-86a7-f0c048d8bfe0 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:43.778173 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a23ee310-07c1-45f1-86a7-f0c048d8bfe0 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:43.779019 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a23ee310-07c1-45f1-86a7-f0c048d8bfe0 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:43.779594 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a23ee310-07c1-45f1-86a7-f0c048d8bfe0 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:43.950053 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-a23ee310-07c1-45f1-86a7-f0c048d8bfe0 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28701 microversion: 2.1 time: 0.185228 May 27 03:43:43.950835 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 228/496] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:43:43 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28701 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:43:43.958049 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-6218fc75-9951-4b75-aeb4-b5beced932f7 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:43.967265 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-6218fc75-9951-4b75-aeb4-b5beced932f7 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0" status: 200 len: 1569 microversion: 2.1 time: 0.239516 May 27 03:43:43.976257 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 269/497] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:43 2021] GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0 => generated 1569 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:43.981521 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-1a770f31-ed37-490d-be7f-43dcd578481e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:43.982533 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-1a770f31-ed37-490d-be7f-43dcd578481e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:43.992564 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1a770f31-ed37-490d-be7f-43dcd578481e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:43.993375 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1a770f31-ed37-490d-be7f-43dcd578481e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:43.994781 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1a770f31-ed37-490d-be7f-43dcd578481e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:43.996919 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1a770f31-ed37-490d-be7f-43dcd578481e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:44.192990 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-1a770f31-ed37-490d-be7f-43dcd578481e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 28693 microversion: 2.20 time: 0.215495 May 27 03:43:44.193630 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 229/498] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:43:43 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 28693 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 27 03:43:44.323195 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-6a933608-836e-404c-b157-99412407fbd1 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2092653431", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-448446547", "security_groups": [{"name": "tempest-secgroup-smoke-1008051492"}], "networks": [{"uuid": "ad9eef72-b0bd-43e0-b9f9-b206091e5c65"}], "block_device_mapping_v2": [{"uuid": "64df504e-95f2-44d3-9422-52c53e3c2937", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:44.578360 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.network.neutron [None req-6a933608-836e-404c-b157-99412407fbd1 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] validate_networks() for [('ad9eef72-b0bd-43e0-b9f9-b206091e5c65', None, None, None)] {{(pid=113020) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 27 03:43:44.963017 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-01edd3c2-4986-4d1f-a23f-ed47bb4022f9 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:44.964658 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-01edd3c2-4986-4d1f-a23f-ed47bb4022f9 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:44.973218 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-01edd3c2-4986-4d1f-a23f-ed47bb4022f9 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:44.981591 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-01edd3c2-4986-4d1f-a23f-ed47bb4022f9 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:44.983244 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-01edd3c2-4986-4d1f-a23f-ed47bb4022f9 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:44.983905 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-01edd3c2-4986-4d1f-a23f-ed47bb4022f9 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:45.111276 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-01edd3c2-4986-4d1f-a23f-ed47bb4022f9 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28701 microversion: 2.1 time: 0.152253 May 27 03:43:45.112150 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 230/499] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:43:44 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28701 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:43:45.117757 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-c10e10ef-bd4f-406c-8033-d8298ec98598 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:45.118579 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-c10e10ef-bd4f-406c-8033-d8298ec98598 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:45.127412 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c10e10ef-bd4f-406c-8033-d8298ec98598 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:45.128086 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c10e10ef-bd4f-406c-8033-d8298ec98598 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:45.128920 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c10e10ef-bd4f-406c-8033-d8298ec98598 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:45.129367 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c10e10ef-bd4f-406c-8033-d8298ec98598 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:45.294542 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.virt.hardware [None req-6a933608-836e-404c-b157-99412407fbd1 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Flavor limits 0:0:0 {{(pid=113020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 27 03:43:45.295046 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.virt.hardware [None req-6a933608-836e-404c-b157-99412407fbd1 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Image limits 0:0:0 {{(pid=113020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 27 03:43:45.295449 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.virt.hardware [None req-6a933608-836e-404c-b157-99412407fbd1 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Flavor pref 0:0:0 {{(pid=113020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 27 03:43:45.295864 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.virt.hardware [None req-6a933608-836e-404c-b157-99412407fbd1 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Image pref 0:0:0 {{(pid=113020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 27 03:43:45.296297 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.virt.hardware [None req-6a933608-836e-404c-b157-99412407fbd1 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=113020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 27 03:43:45.305072 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6a933608-836e-404c-b157-99412407fbd1 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:45.305707 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6a933608-836e-404c-b157-99412407fbd1 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:45.306518 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6a933608-836e-404c-b157-99412407fbd1 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:45.306953 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6a933608-836e-404c-b157-99412407fbd1 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:45.337262 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.quota [None req-6a933608-836e-404c-b157-99412407fbd1 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Getting quotas for project 450ff0f7a98a4ae385a74e4ddaf301ef. Resources: {'instances', 'cores', 'ram'} {{(pid=113020) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 27 03:43:45.341384 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.quota [None req-6a933608-836e-404c-b157-99412407fbd1 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Getting quotas for user 023704e9bd7e4bfcace7a3fa2ec9d919 and project 450ff0f7a98a4ae385a74e4ddaf301ef. Resources: {'instances', 'cores', 'ram'} {{(pid=113020) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 27 03:43:45.425532 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-c10e10ef-bd4f-406c-8033-d8298ec98598 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:45.434683 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-c10e10ef-bd4f-406c-8033-d8298ec98598 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0" status: 200 len: 1569 microversion: 2.1 time: 0.321061 May 27 03:43:45.435448 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 231/500] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:45 2021] GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0 => generated 1569 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:45.440851 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-c2c98bf1-fa0c-4875-8d31-52f88b413427 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:45.441862 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-c2c98bf1-fa0c-4875-8d31-52f88b413427 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:45.449412 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c2c98bf1-fa0c-4875-8d31-52f88b413427 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:45.450083 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c2c98bf1-fa0c-4875-8d31-52f88b413427 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:45.451089 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c2c98bf1-fa0c-4875-8d31-52f88b413427 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:45.452265 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c2c98bf1-fa0c-4875-8d31-52f88b413427 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:45.464106 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-6a933608-836e-404c-b157-99412407fbd1 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Going to run 1 instances... {{(pid=113020) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 27 03:43:45.466803 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-6a933608-836e-404c-b157-99412407fbd1 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] [instance: 02984890-fe33-4d25-bf6d-a3c3163a965f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='64df504e-95f2-44d3-9422-52c53e3c2937',volume_size=None,volume_type=None)] {{(pid=113020) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 27 03:43:45.553032 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-c2c98bf1-fa0c-4875-8d31-52f88b413427 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 28693 microversion: 2.20 time: 0.116051 May 27 03:43:45.553661 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 232/501] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:43:45 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 28693 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:43:45.926865 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-6a933608-836e-404c-b157-99412407fbd1 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.608153 May 27 03:43:45.927543 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 270/502] 10.222.0.25 () {60 vars in 1147 bytes} [Thu May 27 03:43:44 2021] POST /compute/v2.1/servers => generated 406 bytes in 1610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 03:43:45.939211 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-54389073-7266-406c-bd28-a4acaaf6a18e tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:45.939915 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-54389073-7266-406c-bd28-a4acaaf6a18e tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] [instance: 02984890-fe33-4d25-bf6d-a3c3163a965f] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:46.033809 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-54389073-7266-406c-bd28-a4acaaf6a18e tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023704e9bd7e4bfcace7a3fa2ec9d919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450ff0f7a98a4ae385a74e4ddaf301ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:46.051454 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-54389073-7266-406c-bd28-a4acaaf6a18e tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] 10.222.0.25 "GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f" status: 200 len: 1088 microversion: 2.1 time: 0.116412 May 27 03:43:46.061021 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 233/503] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:45 2021] GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f => generated 1088 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:46.123251 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-6a7624c4-eb2a-4228-a2f7-72bbfbe6a193 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:46.124376 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-6a7624c4-eb2a-4228-a2f7-72bbfbe6a193 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:46.132179 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6a7624c4-eb2a-4228-a2f7-72bbfbe6a193 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:46.132712 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6a7624c4-eb2a-4228-a2f7-72bbfbe6a193 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:46.133483 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6a7624c4-eb2a-4228-a2f7-72bbfbe6a193 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:46.133945 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6a7624c4-eb2a-4228-a2f7-72bbfbe6a193 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:46.231899 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-6a7624c4-eb2a-4228-a2f7-72bbfbe6a193 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28701 microversion: 2.1 time: 0.112110 May 27 03:43:46.232474 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 271/504] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:43:46 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28701 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:43:46.452110 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-496845d3-2446-456d-84a0-fb5b879726e5 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:46.453047 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-496845d3-2446-456d-84a0-fb5b879726e5 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:46.462609 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-496845d3-2446-456d-84a0-fb5b879726e5 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:46.463062 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-496845d3-2446-456d-84a0-fb5b879726e5 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:46.463842 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-496845d3-2446-456d-84a0-fb5b879726e5 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:46.464282 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-496845d3-2446-456d-84a0-fb5b879726e5 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:46.565633 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-59f9910c-dc8a-4668-abfd-afe86dbda621 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:46.568005 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-59f9910c-dc8a-4668-abfd-afe86dbda621 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:46.587750 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-59f9910c-dc8a-4668-abfd-afe86dbda621 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:46.588200 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-59f9910c-dc8a-4668-abfd-afe86dbda621 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:46.589200 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-59f9910c-dc8a-4668-abfd-afe86dbda621 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:46.589925 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-59f9910c-dc8a-4668-abfd-afe86dbda621 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:46.689926 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-496845d3-2446-456d-84a0-fb5b879726e5 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:46.702633 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-496845d3-2446-456d-84a0-fb5b879726e5 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0" status: 200 len: 1549 microversion: 2.1 time: 0.254178 May 27 03:43:46.703541 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 234/505] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:46 2021] GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0 => generated 1549 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:46.720319 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-c1516525-7461-43e4-87ee-2f901207f33f tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:46.720880 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-c1516525-7461-43e4-87ee-2f901207f33f tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:46.728906 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c1516525-7461-43e4-87ee-2f901207f33f tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:46.729616 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c1516525-7461-43e4-87ee-2f901207f33f tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:46.730153 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c1516525-7461-43e4-87ee-2f901207f33f tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:46.730586 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c1516525-7461-43e4-87ee-2f901207f33f tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:46.899466 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.wsgi [None req-c1516525-7461-43e4-87ee-2f901207f33f tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] HTTP exception thrown: Cannot 'detach_volume' instance 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0 while it is in vm_state rescued May 27 03:43:46.900073 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-c1516525-7461-43e4-87ee-2f901207f33f tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Returning 409 to user: Cannot 'detach_volume' instance 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0 while it is in vm_state rescued {{(pid=113021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 27 03:43:46.901047 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-c1516525-7461-43e4-87ee-2f901207f33f tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0/os-volume_attachments/164e4da2-e84c-4cac-9094-bb0cf941dd13" status: 409 len: 152 microversion: 2.1 time: 0.185190 May 27 03:43:46.901597 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 235/506] 10.222.0.25 () {58 vars in 1416 bytes} [Thu May 27 03:43:46 2021] DELETE /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0/os-volume_attachments/164e4da2-e84c-4cac-9094-bb0cf941dd13 => generated 152 bytes in 186 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) May 27 03:43:46.910251 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-69ccd4f4-17ba-485e-b8b4-7eb981459ba4 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:46.910947 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-69ccd4f4-17ba-485e-b8b4-7eb981459ba4 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:46.930157 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-69ccd4f4-17ba-485e-b8b4-7eb981459ba4 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:46.930157 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-69ccd4f4-17ba-485e-b8b4-7eb981459ba4 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:46.930157 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-69ccd4f4-17ba-485e-b8b4-7eb981459ba4 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:46.930157 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-69ccd4f4-17ba-485e-b8b4-7eb981459ba4 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:46.948633 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-59f9910c-dc8a-4668-abfd-afe86dbda621 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 28693 microversion: 2.20 time: 0.386915 May 27 03:43:46.949934 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 272/507] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:43:46 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 28693 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 27 03:43:47.069212 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-ff512c1b-d685-4640-8509-306bed116046 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:47.070175 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-ff512c1b-d685-4640-8509-306bed116046 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] [instance: 02984890-fe33-4d25-bf6d-a3c3163a965f] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:47.079345 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ff512c1b-d685-4640-8509-306bed116046 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:47.080106 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ff512c1b-d685-4640-8509-306bed116046 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:47.081085 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ff512c1b-d685-4640-8509-306bed116046 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:47.081708 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ff512c1b-d685-4640-8509-306bed116046 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:47.221486 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-69ccd4f4-17ba-485e-b8b4-7eb981459ba4 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "POST /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0/action" status: 202 len: 0 microversion: 2.1 time: 0.302346 May 27 03:43:47.226802 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 236/508] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:43:46 2021] POST /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0/action => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:43:47.240388 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-ff512c1b-d685-4640-8509-306bed116046 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023704e9bd7e4bfcace7a3fa2ec9d919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450ff0f7a98a4ae385a74e4ddaf301ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:47.249698 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-ff512c1b-d685-4640-8509-306bed116046 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] 10.222.0.25 "GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f" status: 200 len: 1138 microversion: 2.1 time: 0.184637 May 27 03:43:47.251357 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 273/509] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:47 2021] GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f => generated 1138 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:47.255971 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-4e8a69d1-db7c-4c38-aa8b-a1519afa0c8e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:47.257113 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-4e8a69d1-db7c-4c38-aa8b-a1519afa0c8e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:47.264818 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-0c404aa5-b1d2-47f7-87f5-8a62a1451c1c tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:47.267467 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4e8a69d1-db7c-4c38-aa8b-a1519afa0c8e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:47.267594 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-0c404aa5-b1d2-47f7-87f5-8a62a1451c1c tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:47.267932 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4e8a69d1-db7c-4c38-aa8b-a1519afa0c8e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:47.273564 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4e8a69d1-db7c-4c38-aa8b-a1519afa0c8e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:47.274035 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4e8a69d1-db7c-4c38-aa8b-a1519afa0c8e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:47.279173 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-0c404aa5-b1d2-47f7-87f5-8a62a1451c1c tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:47.280050 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-0c404aa5-b1d2-47f7-87f5-8a62a1451c1c tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:47.281167 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-0c404aa5-b1d2-47f7-87f5-8a62a1451c1c tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:47.281945 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-0c404aa5-b1d2-47f7-87f5-8a62a1451c1c tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:47.379266 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-4e8a69d1-db7c-4c38-aa8b-a1519afa0c8e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28701 microversion: 2.1 time: 0.126477 May 27 03:43:47.379943 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 274/510] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:43:47 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28701 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:43:47.699404 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-0c404aa5-b1d2-47f7-87f5-8a62a1451c1c tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:47.711196 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-0c404aa5-b1d2-47f7-87f5-8a62a1451c1c tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0" status: 200 len: 1557 microversion: 2.1 time: 0.481386 May 27 03:43:47.732342 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 237/511] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:47 2021] GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0 => generated 1557 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:47.967832 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-055099a8-968c-41fc-83be-c927a953c617 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:47.970126 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-055099a8-968c-41fc-83be-c927a953c617 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:47.979807 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-055099a8-968c-41fc-83be-c927a953c617 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:47.980496 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-055099a8-968c-41fc-83be-c927a953c617 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:47.981433 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-055099a8-968c-41fc-83be-c927a953c617 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:47.982072 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-055099a8-968c-41fc-83be-c927a953c617 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:48.104829 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-055099a8-968c-41fc-83be-c927a953c617 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 28693 microversion: 2.20 time: 0.141658 May 27 03:43:48.105884 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 275/512] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:43:47 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 28693 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:43:48.271917 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-dba29904-5ad6-4b8c-a10f-a2428e5a7c3d tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:48.272646 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-dba29904-5ad6-4b8c-a10f-a2428e5a7c3d tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] [instance: 02984890-fe33-4d25-bf6d-a3c3163a965f] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:48.284362 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-dba29904-5ad6-4b8c-a10f-a2428e5a7c3d tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:48.285014 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-dba29904-5ad6-4b8c-a10f-a2428e5a7c3d tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:48.286040 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-dba29904-5ad6-4b8c-a10f-a2428e5a7c3d tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:48.286550 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-dba29904-5ad6-4b8c-a10f-a2428e5a7c3d tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:48.393935 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-9ed5976b-90f8-4b06-ab0b-ff3dc8b38de3 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:48.393935 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-9ed5976b-90f8-4b06-ab0b-ff3dc8b38de3 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:48.400973 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9ed5976b-90f8-4b06-ab0b-ff3dc8b38de3 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:48.401625 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9ed5976b-90f8-4b06-ab0b-ff3dc8b38de3 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:48.402645 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9ed5976b-90f8-4b06-ab0b-ff3dc8b38de3 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:48.403238 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9ed5976b-90f8-4b06-ab0b-ff3dc8b38de3 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:48.494223 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-dba29904-5ad6-4b8c-a10f-a2428e5a7c3d tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023704e9bd7e4bfcace7a3fa2ec9d919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450ff0f7a98a4ae385a74e4ddaf301ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:48.503735 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-dba29904-5ad6-4b8c-a10f-a2428e5a7c3d tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] 10.222.0.25 "GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f" status: 200 len: 1194 microversion: 2.1 time: 0.237399 May 27 03:43:48.504467 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 238/513] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:48 2021] GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f => generated 1194 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:48.504747 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-9ed5976b-90f8-4b06-ab0b-ff3dc8b38de3 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28701 microversion: 2.1 time: 0.117106 May 27 03:43:48.505667 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 276/514] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:43:48 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28701 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:43:48.730656 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-ced610a8-37da-4d6c-b679-b5f2b34f8dc6 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:48.731589 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-ced610a8-37da-4d6c-b679-b5f2b34f8dc6 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:48.742704 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ced610a8-37da-4d6c-b679-b5f2b34f8dc6 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:48.743640 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ced610a8-37da-4d6c-b679-b5f2b34f8dc6 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:48.744910 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ced610a8-37da-4d6c-b679-b5f2b34f8dc6 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:48.745767 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ced610a8-37da-4d6c-b679-b5f2b34f8dc6 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:49.079832 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-e1d91878-27e5-48f5-aefd-33fbaaf3f5a0 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:49.081006 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-e1d91878-27e5-48f5-aefd-33fbaaf3f5a0 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 7caeff19-8b2a-4c81-b6f2-1178b3f1a561] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:49.089400 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e1d91878-27e5-48f5-aefd-33fbaaf3f5a0 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:49.090104 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e1d91878-27e5-48f5-aefd-33fbaaf3f5a0 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:49.091044 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e1d91878-27e5-48f5-aefd-33fbaaf3f5a0 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:49.091631 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e1d91878-27e5-48f5-aefd-33fbaaf3f5a0 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:49.221158 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-ced610a8-37da-4d6c-b679-b5f2b34f8dc6 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:49.231532 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-ced610a8-37da-4d6c-b679-b5f2b34f8dc6 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0" status: 200 len: 1557 microversion: 2.1 time: 0.506035 May 27 03:43:49.233120 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 239/515] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:48 2021] GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0 => generated 1557 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:49.239203 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-e669082f-f0f7-427c-b066-b232e8338112 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:49.240204 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-e669082f-f0f7-427c-b066-b232e8338112 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:49.249185 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e669082f-f0f7-427c-b066-b232e8338112 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:49.250110 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e669082f-f0f7-427c-b066-b232e8338112 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:49.251102 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e669082f-f0f7-427c-b066-b232e8338112 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:49.251700 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e669082f-f0f7-427c-b066-b232e8338112 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:49.293656 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.objects.instance [None req-e1d91878-27e5-48f5-aefd-33fbaaf3f5a0 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lazy-loading 'services' on Instance uuid 7caeff19-8b2a-4c81-b6f2-1178b3f1a561 {{(pid=113020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 27 03:43:49.438936 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-e669082f-f0f7-427c-b066-b232e8338112 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 28693 microversion: 2.20 time: 0.204013 May 27 03:43:49.444277 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 240/516] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:43:49 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 28693 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:43:49.517396 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-e86c79b6-aa1b-41bf-ad24-6da70161be66 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:49.519086 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-e86c79b6-aa1b-41bf-ad24-6da70161be66 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:49.526713 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e86c79b6-aa1b-41bf-ad24-6da70161be66 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:49.527161 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e86c79b6-aa1b-41bf-ad24-6da70161be66 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:49.527935 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e86c79b6-aa1b-41bf-ad24-6da70161be66 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:49.528371 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e86c79b6-aa1b-41bf-ad24-6da70161be66 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:49.616833 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-e1d91878-27e5-48f5-aefd-33fbaaf3f5a0 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7caeff19-8b2a-4c81-b6f2-1178b3f1a561/os-volume_attachments/50fd06d4-dc70-4cd8-8684-ee2a5fb942ae" status: 202 len: 0 microversion: 2.1 time: 0.541090 May 27 03:43:49.618864 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 277/517] 10.222.0.25 () {58 vars in 1416 bytes} [Thu May 27 03:43:49 2021] DELETE /compute/v2.1/servers/7caeff19-8b2a-4c81-b6f2-1178b3f1a561/os-volume_attachments/50fd06d4-dc70-4cd8-8684-ee2a5fb942ae => generated 0 bytes in 544 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:43:49.624182 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-1dc0b605-3414-4bed-b4b6-c44a95a89531 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:49.624932 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-1dc0b605-3414-4bed-b4b6-c44a95a89531 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] [instance: 02984890-fe33-4d25-bf6d-a3c3163a965f] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:49.640046 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-e86c79b6-aa1b-41bf-ad24-6da70161be66 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28701 microversion: 2.1 time: 0.127003 May 27 03:43:49.641001 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 241/518] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:43:49 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28701 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 03:43:49.649720 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1dc0b605-3414-4bed-b4b6-c44a95a89531 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:49.651876 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1dc0b605-3414-4bed-b4b6-c44a95a89531 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:49.652702 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1dc0b605-3414-4bed-b4b6-c44a95a89531 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:49.653442 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1dc0b605-3414-4bed-b4b6-c44a95a89531 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:49.941416 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-1dc0b605-3414-4bed-b4b6-c44a95a89531 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023704e9bd7e4bfcace7a3fa2ec9d919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450ff0f7a98a4ae385a74e4ddaf301ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:49.960870 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-1dc0b605-3414-4bed-b4b6-c44a95a89531 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] 10.222.0.25 "GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f" status: 200 len: 1272 microversion: 2.1 time: 0.340649 May 27 03:43:49.970449 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 278/519] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:49 2021] GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f => generated 1272 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:50.253275 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-a3952ac4-cede-4abe-982e-7f0d1f47fbcc tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:50.254139 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-a3952ac4-cede-4abe-982e-7f0d1f47fbcc tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:50.263178 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a3952ac4-cede-4abe-982e-7f0d1f47fbcc tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:50.264059 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a3952ac4-cede-4abe-982e-7f0d1f47fbcc tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:50.265103 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a3952ac4-cede-4abe-982e-7f0d1f47fbcc tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:50.265807 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a3952ac4-cede-4abe-982e-7f0d1f47fbcc tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:50.454894 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-733baaa6-1122-433b-b9a8-1fb4282928d7 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:50.456545 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-733baaa6-1122-433b-b9a8-1fb4282928d7 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:50.472324 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-733baaa6-1122-433b-b9a8-1fb4282928d7 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:50.474128 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-733baaa6-1122-433b-b9a8-1fb4282928d7 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:50.477638 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-733baaa6-1122-433b-b9a8-1fb4282928d7 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:50.478491 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-733baaa6-1122-433b-b9a8-1fb4282928d7 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:50.612771 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-733baaa6-1122-433b-b9a8-1fb4282928d7 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 28693 microversion: 2.20 time: 0.161364 May 27 03:43:50.617641 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 279/520] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:43:50 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 28693 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:43:50.631774 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-a3952ac4-cede-4abe-982e-7f0d1f47fbcc tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:50.645019 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-a3952ac4-cede-4abe-982e-7f0d1f47fbcc tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0" status: 200 len: 1557 microversion: 2.1 time: 0.392079 May 27 03:43:50.647146 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 242/521] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:50 2021] GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0 => generated 1557 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:50.662652 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-ffca7c55-e5af-48f6-bb0d-9444391d8233 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:50.663687 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-ffca7c55-e5af-48f6-bb0d-9444391d8233 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:50.673968 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ffca7c55-e5af-48f6-bb0d-9444391d8233 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:50.674425 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ffca7c55-e5af-48f6-bb0d-9444391d8233 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:50.675215 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ffca7c55-e5af-48f6-bb0d-9444391d8233 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:50.675648 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ffca7c55-e5af-48f6-bb0d-9444391d8233 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:50.800171 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-ffca7c55-e5af-48f6-bb0d-9444391d8233 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28701 microversion: 2.1 time: 0.151098 May 27 03:43:50.801551 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 280/522] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:43:50 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28701 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 03:43:50.977280 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-125cd234-1388-4314-94c8-507c56665cd1 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:50.977928 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-125cd234-1388-4314-94c8-507c56665cd1 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] [instance: 02984890-fe33-4d25-bf6d-a3c3163a965f] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:50.985456 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-125cd234-1388-4314-94c8-507c56665cd1 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:50.986111 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-125cd234-1388-4314-94c8-507c56665cd1 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:50.987249 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-125cd234-1388-4314-94c8-507c56665cd1 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:50.988354 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-125cd234-1388-4314-94c8-507c56665cd1 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:51.627407 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-70a84f02-1d04-4d18-a39a-4abf9fee6f41 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:51.629076 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-70a84f02-1d04-4d18-a39a-4abf9fee6f41 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:51.637599 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-70a84f02-1d04-4d18-a39a-4abf9fee6f41 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:51.638052 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-70a84f02-1d04-4d18-a39a-4abf9fee6f41 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:51.638826 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-70a84f02-1d04-4d18-a39a-4abf9fee6f41 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:51.639257 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-70a84f02-1d04-4d18-a39a-4abf9fee6f41 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:51.655498 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-125cd234-1388-4314-94c8-507c56665cd1 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023704e9bd7e4bfcace7a3fa2ec9d919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450ff0f7a98a4ae385a74e4ddaf301ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:51.678792 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-125cd234-1388-4314-94c8-507c56665cd1 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] 10.222.0.25 "GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f" status: 200 len: 1260 microversion: 2.1 time: 0.705384 May 27 03:43:51.688309 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 243/523] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:50 2021] GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f => generated 1260 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:51.688309 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [req-96177abf-3b2f-455c-854b-6ce14ff53c1f req-14a74d2e-463c-4dd5-a4be-a61c63ea6a6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02984890-fe33-4d25-bf6d-a3c3163a965f", "tag": "2554297d-a794-4bc9-9cb3-56dce4e9fb2f"}]} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:51.688309 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:43:51.688309 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: warnings.warn(msg) May 27 03:43:51.700940 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-96177abf-3b2f-455c-854b-6ce14ff53c1f req-14a74d2e-463c-4dd5-a4be-a61c63ea6a6e service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:51.701433 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-96177abf-3b2f-455c-854b-6ce14ff53c1f req-14a74d2e-463c-4dd5-a4be-a61c63ea6a6e service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:51.723735 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.compute.server_external_events [req-96177abf-3b2f-455c-854b-6ce14ff53c1f req-14a74d2e-463c-4dd5-a4be-a61c63ea6a6e service nova] Creating event network-changed:2554297d-a794-4bc9-9cb3-56dce4e9fb2f for instance 02984890-fe33-4d25-bf6d-a3c3163a965f on hv-cinder-79326 May 27 03:43:51.731041 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [req-96177abf-3b2f-455c-854b-6ce14ff53c1f req-14a74d2e-463c-4dd5-a4be-a61c63ea6a6e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049576 May 27 03:43:51.733043 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 244/524] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:43:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:43:51.739180 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-dad3cc1f-ef49-4a82-8d92-6d8b0afc6ab5 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:51.740115 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-dad3cc1f-ef49-4a82-8d92-6d8b0afc6ab5 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:51.748304 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-dad3cc1f-ef49-4a82-8d92-6d8b0afc6ab5 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:51.748843 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-dad3cc1f-ef49-4a82-8d92-6d8b0afc6ab5 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:51.749732 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-dad3cc1f-ef49-4a82-8d92-6d8b0afc6ab5 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:51.750067 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-dad3cc1f-ef49-4a82-8d92-6d8b0afc6ab5 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:51.786902 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-70a84f02-1d04-4d18-a39a-4abf9fee6f41 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 28693 microversion: 2.20 time: 0.163296 May 27 03:43:51.788474 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 281/525] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:43:51 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 28693 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:43:51.832145 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-ffb37818-cdde-4877-9d73-b23f0e76b3f9 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:51.834807 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-ffb37818-cdde-4877-9d73-b23f0e76b3f9 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:51.850108 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ffb37818-cdde-4877-9d73-b23f0e76b3f9 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:51.855607 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ffb37818-cdde-4877-9d73-b23f0e76b3f9 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:51.859299 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ffb37818-cdde-4877-9d73-b23f0e76b3f9 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:51.863981 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ffb37818-cdde-4877-9d73-b23f0e76b3f9 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:52.051780 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-ffb37818-cdde-4877-9d73-b23f0e76b3f9 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28701 microversion: 2.1 time: 0.241901 May 27 03:43:52.053144 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 282/526] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:43:51 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28701 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:43:52.193655 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-dad3cc1f-ef49-4a82-8d92-6d8b0afc6ab5 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:52.203420 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-dad3cc1f-ef49-4a82-8d92-6d8b0afc6ab5 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0" status: 200 len: 1557 microversion: 2.1 time: 0.469377 May 27 03:43:52.204045 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 245/527] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:51 2021] GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0 => generated 1557 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:52.695263 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-bc73ef1e-2196-4632-9a78-a5c2cf48d0fc tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:52.695951 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-bc73ef1e-2196-4632-9a78-a5c2cf48d0fc tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] [instance: 02984890-fe33-4d25-bf6d-a3c3163a965f] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:52.704361 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-bc73ef1e-2196-4632-9a78-a5c2cf48d0fc tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:52.704853 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-bc73ef1e-2196-4632-9a78-a5c2cf48d0fc tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:52.705636 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-bc73ef1e-2196-4632-9a78-a5c2cf48d0fc tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:52.706136 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-bc73ef1e-2196-4632-9a78-a5c2cf48d0fc tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:52.801955 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-e895d210-cffa-44a0-9cbf-6a1e3e16e158 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:52.803656 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-e895d210-cffa-44a0-9cbf-6a1e3e16e158 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:52.813837 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e895d210-cffa-44a0-9cbf-6a1e3e16e158 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:52.814658 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e895d210-cffa-44a0-9cbf-6a1e3e16e158 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:52.816041 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e895d210-cffa-44a0-9cbf-6a1e3e16e158 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:52.816703 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e895d210-cffa-44a0-9cbf-6a1e3e16e158 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:52.995827 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-bc73ef1e-2196-4632-9a78-a5c2cf48d0fc tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023704e9bd7e4bfcace7a3fa2ec9d919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450ff0f7a98a4ae385a74e4ddaf301ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:53.008994 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-bc73ef1e-2196-4632-9a78-a5c2cf48d0fc tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] 10.222.0.25 "GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f" status: 200 len: 1260 microversion: 2.1 time: 0.317616 May 27 03:43:53.009674 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 283/528] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:52 2021] GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f => generated 1260 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:53.063673 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-306defd1-9a0f-4cb8-889c-0561e21b74b9 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:53.064827 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-306defd1-9a0f-4cb8-889c-0561e21b74b9 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:53.073188 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-306defd1-9a0f-4cb8-889c-0561e21b74b9 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:53.073642 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-306defd1-9a0f-4cb8-889c-0561e21b74b9 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:53.074943 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-306defd1-9a0f-4cb8-889c-0561e21b74b9 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:53.075395 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-306defd1-9a0f-4cb8-889c-0561e21b74b9 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:53.169459 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-e895d210-cffa-44a0-9cbf-6a1e3e16e158 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 28693 microversion: 2.20 time: 0.372624 May 27 03:43:53.170447 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 246/529] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:43:52 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 28693 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 27 03:43:53.193993 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-306defd1-9a0f-4cb8-889c-0561e21b74b9 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28701 microversion: 2.1 time: 0.134491 May 27 03:43:53.195289 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 284/530] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:43:53 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28701 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 03:43:53.222314 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-ff8eb069-9ad1-46d9-bb7a-8994d1e28f45 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:53.223601 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-ff8eb069-9ad1-46d9-bb7a-8994d1e28f45 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:53.233018 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ff8eb069-9ad1-46d9-bb7a-8994d1e28f45 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:53.233755 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ff8eb069-9ad1-46d9-bb7a-8994d1e28f45 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:53.234797 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ff8eb069-9ad1-46d9-bb7a-8994d1e28f45 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:53.235478 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ff8eb069-9ad1-46d9-bb7a-8994d1e28f45 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:53.591294 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-ff8eb069-9ad1-46d9-bb7a-8994d1e28f45 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:53.620105 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-ff8eb069-9ad1-46d9-bb7a-8994d1e28f45 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0" status: 200 len: 1563 microversion: 2.1 time: 0.402802 May 27 03:43:53.620938 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 247/531] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:53 2021] GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0 => generated 1563 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:53.738652 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-244cbc2b-b6f4-4b60-84a8-09038a6ded6f tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:53.739244 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-244cbc2b-b6f4-4b60-84a8-09038a6ded6f tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:53.747026 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-244cbc2b-b6f4-4b60-84a8-09038a6ded6f tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:53.747480 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-244cbc2b-b6f4-4b60-84a8-09038a6ded6f tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:53.748259 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-244cbc2b-b6f4-4b60-84a8-09038a6ded6f tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:53.748726 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-244cbc2b-b6f4-4b60-84a8-09038a6ded6f tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:53.926467 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.objects.instance [None req-244cbc2b-b6f4-4b60-84a8-09038a6ded6f tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lazy-loading 'services' on Instance uuid 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0 {{(pid=113020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 27 03:43:54.026755 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-1e5d029d-5033-4928-b114-835bb56b25fa tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:54.027480 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-1e5d029d-5033-4928-b114-835bb56b25fa tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] [instance: 02984890-fe33-4d25-bf6d-a3c3163a965f] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:54.035971 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1e5d029d-5033-4928-b114-835bb56b25fa tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:54.036917 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1e5d029d-5033-4928-b114-835bb56b25fa tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:54.037706 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1e5d029d-5033-4928-b114-835bb56b25fa tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:54.040289 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1e5d029d-5033-4928-b114-835bb56b25fa tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:54.285069 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-244cbc2b-b6f4-4b60-84a8-09038a6ded6f tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0/os-volume_attachments/164e4da2-e84c-4cac-9094-bb0cf941dd13" status: 202 len: 0 microversion: 2.1 time: 0.548822 May 27 03:43:54.285574 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 285/532] 10.222.0.25 () {58 vars in 1416 bytes} [Thu May 27 03:43:53 2021] DELETE /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0/os-volume_attachments/164e4da2-e84c-4cac-9094-bb0cf941dd13 => generated 0 bytes in 553 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:43:54.299928 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-7e05e1b3-9284-49a6-8873-e971a880c5d0 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:54.302704 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-7e05e1b3-9284-49a6-8873-e971a880c5d0 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:54.322787 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7e05e1b3-9284-49a6-8873-e971a880c5d0 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:54.328891 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7e05e1b3-9284-49a6-8873-e971a880c5d0 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:54.328891 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7e05e1b3-9284-49a6-8873-e971a880c5d0 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:54.328891 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7e05e1b3-9284-49a6-8873-e971a880c5d0 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:54.361594 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-1e5d029d-5033-4928-b114-835bb56b25fa tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023704e9bd7e4bfcace7a3fa2ec9d919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450ff0f7a98a4ae385a74e4ddaf301ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:54.372270 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-1e5d029d-5033-4928-b114-835bb56b25fa tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] 10.222.0.25 "GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f" status: 200 len: 1260 microversion: 2.1 time: 0.349579 May 27 03:43:54.377164 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 248/533] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:54 2021] GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f => generated 1260 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:43:54.384795 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-1a27385a-c4cd-4dec-87ac-125be5b4f250 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:54.385733 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-1a27385a-c4cd-4dec-87ac-125be5b4f250 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:54.393634 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1a27385a-c4cd-4dec-87ac-125be5b4f250 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:54.394279 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1a27385a-c4cd-4dec-87ac-125be5b4f250 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:54.395835 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1a27385a-c4cd-4dec-87ac-125be5b4f250 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:54.396718 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1a27385a-c4cd-4dec-87ac-125be5b4f250 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:54.472057 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-7e05e1b3-9284-49a6-8873-e971a880c5d0 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 28693 microversion: 2.20 time: 0.183843 May 27 03:43:54.472761 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 286/534] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:43:54 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 28693 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:43:54.528678 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-1a27385a-c4cd-4dec-87ac-125be5b4f250 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28701 microversion: 2.1 time: 0.149564 May 27 03:43:54.533074 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 249/535] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:43:54 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28701 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:43:54.667867 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-06e0736f-6fdc-47e1-b7af-07aae748435a tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:54.668498 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-06e0736f-6fdc-47e1-b7af-07aae748435a tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 7caeff19-8b2a-4c81-b6f2-1178b3f1a561] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:54.678184 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-06e0736f-6fdc-47e1-b7af-07aae748435a tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:54.678652 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-06e0736f-6fdc-47e1-b7af-07aae748435a tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:54.679524 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-06e0736f-6fdc-47e1-b7af-07aae748435a tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:54.679985 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-06e0736f-6fdc-47e1-b7af-07aae748435a tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:54.751121 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-06e0736f-6fdc-47e1-b7af-07aae748435a tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 7caeff19-8b2a-4c81-b6f2-1178b3f1a561] Going to try to terminate instance {{(pid=113020) delete /opt/stack/nova/nova/compute/api.py:2539}} May 27 03:43:55.096965 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-06e0736f-6fdc-47e1-b7af-07aae748435a tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7caeff19-8b2a-4c81-b6f2-1178b3f1a561" status: 204 len: 0 microversion: 2.1 time: 0.432975 May 27 03:43:55.097683 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 287/536] 10.222.0.25 () {58 vars in 1239 bytes} [Thu May 27 03:43:54 2021] DELETE /compute/v2.1/servers/7caeff19-8b2a-4c81-b6f2-1178b3f1a561 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 03:43:55.111388 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-8f028e04-ea70-448e-8adc-bfa348d8e6a7 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:55.113354 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-8f028e04-ea70-448e-8adc-bfa348d8e6a7 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 7caeff19-8b2a-4c81-b6f2-1178b3f1a561] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:55.130141 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8f028e04-ea70-448e-8adc-bfa348d8e6a7 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:55.130860 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8f028e04-ea70-448e-8adc-bfa348d8e6a7 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:55.131809 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8f028e04-ea70-448e-8adc-bfa348d8e6a7 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:55.132454 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8f028e04-ea70-448e-8adc-bfa348d8e6a7 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:55.390116 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-5b477dbc-e3ec-48f4-9579-23f810733592 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:55.390897 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-5b477dbc-e3ec-48f4-9579-23f810733592 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] [instance: 02984890-fe33-4d25-bf6d-a3c3163a965f] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:55.398758 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-5b477dbc-e3ec-48f4-9579-23f810733592 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:55.399363 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-5b477dbc-e3ec-48f4-9579-23f810733592 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:55.400252 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-5b477dbc-e3ec-48f4-9579-23f810733592 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:55.400829 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-5b477dbc-e3ec-48f4-9579-23f810733592 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:55.615319 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-8f028e04-ea70-448e-8adc-bfa348d8e6a7 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:55.620426 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-5b477dbc-e3ec-48f4-9579-23f810733592 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023704e9bd7e4bfcace7a3fa2ec9d919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450ff0f7a98a4ae385a74e4ddaf301ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:55.624046 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-8f028e04-ea70-448e-8adc-bfa348d8e6a7 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/7caeff19-8b2a-4c81-b6f2-1178b3f1a561" status: 200 len: 1513 microversion: 2.1 time: 0.521144 May 27 03:43:55.624656 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 250/537] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:55 2021] GET /compute/v2.1/servers/7caeff19-8b2a-4c81-b6f2-1178b3f1a561 => generated 1513 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:55.629693 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-5b477dbc-e3ec-48f4-9579-23f810733592 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] 10.222.0.25 "GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f" status: 200 len: 1260 microversion: 2.1 time: 0.243975 May 27 03:43:55.630457 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 288/538] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:55 2021] GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f => generated 1260 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:43:55.634210 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-58631392-c9b3-4174-b29d-ce1602176be7 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:55.635361 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-58631392-c9b3-4174-b29d-ce1602176be7 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:55.643493 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-31021c9d-3188-4b85-8e99-4286554551eb tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:55.644164 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-58631392-c9b3-4174-b29d-ce1602176be7 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:55.644732 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-58631392-c9b3-4174-b29d-ce1602176be7 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:55.644850 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-31021c9d-3188-4b85-8e99-4286554551eb tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:55.645641 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-58631392-c9b3-4174-b29d-ce1602176be7 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:55.646180 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-58631392-c9b3-4174-b29d-ce1602176be7 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:55.652087 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-31021c9d-3188-4b85-8e99-4286554551eb tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:55.652575 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-31021c9d-3188-4b85-8e99-4286554551eb tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:55.653406 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-31021c9d-3188-4b85-8e99-4286554551eb tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:55.653844 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-31021c9d-3188-4b85-8e99-4286554551eb tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:55.763462 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-58631392-c9b3-4174-b29d-ce1602176be7 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 28693 microversion: 2.20 time: 0.133516 May 27 03:43:55.764112 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 251/539] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:43:55 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 28693 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:43:55.783458 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-31021c9d-3188-4b85-8e99-4286554551eb tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28701 microversion: 2.1 time: 0.151149 May 27 03:43:55.784186 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 289/540] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:43:55 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28701 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:43:56.641720 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-cc67df2b-19a5-429f-bd2b-84b244bf2758 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:56.644724 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-cc67df2b-19a5-429f-bd2b-84b244bf2758 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 7caeff19-8b2a-4c81-b6f2-1178b3f1a561] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:56.651154 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-49377578-4125-4e16-97d6-a8b07ae02d26 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:56.651996 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-49377578-4125-4e16-97d6-a8b07ae02d26 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] [instance: 02984890-fe33-4d25-bf6d-a3c3163a965f] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:56.653092 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-cc67df2b-19a5-429f-bd2b-84b244bf2758 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:56.653749 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-cc67df2b-19a5-429f-bd2b-84b244bf2758 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:56.654547 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-cc67df2b-19a5-429f-bd2b-84b244bf2758 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:56.654995 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-cc67df2b-19a5-429f-bd2b-84b244bf2758 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:56.663335 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-49377578-4125-4e16-97d6-a8b07ae02d26 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:56.663886 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-49377578-4125-4e16-97d6-a8b07ae02d26 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:56.665204 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-49377578-4125-4e16-97d6-a8b07ae02d26 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:56.665915 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-49377578-4125-4e16-97d6-a8b07ae02d26 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:56.900644 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-49377578-4125-4e16-97d6-a8b07ae02d26 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023704e9bd7e4bfcace7a3fa2ec9d919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450ff0f7a98a4ae385a74e4ddaf301ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:56.910060 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-49377578-4125-4e16-97d6-a8b07ae02d26 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] 10.222.0.25 "GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f" status: 200 len: 1260 microversion: 2.1 time: 0.263863 May 27 03:43:56.911196 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 290/541] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:56 2021] GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f => generated 1260 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:43:56.918187 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-4390a68e-bb1d-4053-8a90-a382db3e3b43 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:56.919366 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-4390a68e-bb1d-4053-8a90-a382db3e3b43 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:56.927534 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4390a68e-bb1d-4053-8a90-a382db3e3b43 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:56.944608 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4390a68e-bb1d-4053-8a90-a382db3e3b43 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:56.944608 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4390a68e-bb1d-4053-8a90-a382db3e3b43 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:56.944608 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4390a68e-bb1d-4053-8a90-a382db3e3b43 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:56.983937 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-cc67df2b-19a5-429f-bd2b-84b244bf2758 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:56.996113 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-cc67df2b-19a5-429f-bd2b-84b244bf2758 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/7caeff19-8b2a-4c81-b6f2-1178b3f1a561" status: 200 len: 1513 microversion: 2.1 time: 0.356492 May 27 03:43:56.997348 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 252/542] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:56 2021] GET /compute/v2.1/servers/7caeff19-8b2a-4c81-b6f2-1178b3f1a561 => generated 1513 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:57.009181 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-42c1c2e9-0535-47ae-ac62-f5db385b19b7 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:57.010591 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-42c1c2e9-0535-47ae-ac62-f5db385b19b7 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:57.019061 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-42c1c2e9-0535-47ae-ac62-f5db385b19b7 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:57.019501 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-42c1c2e9-0535-47ae-ac62-f5db385b19b7 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:57.020286 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-42c1c2e9-0535-47ae-ac62-f5db385b19b7 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:57.020768 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-42c1c2e9-0535-47ae-ac62-f5db385b19b7 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:57.071100 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-4390a68e-bb1d-4053-8a90-a382db3e3b43 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 28693 microversion: 2.20 time: 0.158124 May 27 03:43:57.072710 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 291/543] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:43:56 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 28693 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:43:57.173224 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-42c1c2e9-0535-47ae-ac62-f5db385b19b7 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28701 microversion: 2.1 time: 0.171447 May 27 03:43:57.174406 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 253/544] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:43:56 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28701 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:43:57.927973 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-365f85ad-7a5f-4a44-8408-53a8c0dd19ab tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:57.940555 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-365f85ad-7a5f-4a44-8408-53a8c0dd19ab tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] [instance: 02984890-fe33-4d25-bf6d-a3c3163a965f] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:57.943474 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-365f85ad-7a5f-4a44-8408-53a8c0dd19ab tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:57.943925 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-365f85ad-7a5f-4a44-8408-53a8c0dd19ab tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:57.944920 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-365f85ad-7a5f-4a44-8408-53a8c0dd19ab tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:57.945372 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-365f85ad-7a5f-4a44-8408-53a8c0dd19ab tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:58.020226 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-2ac8751b-7e7f-4420-9c1f-5548023832c1 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:58.021124 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-2ac8751b-7e7f-4420-9c1f-5548023832c1 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 7caeff19-8b2a-4c81-b6f2-1178b3f1a561] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:58.029646 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2ac8751b-7e7f-4420-9c1f-5548023832c1 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:58.030199 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2ac8751b-7e7f-4420-9c1f-5548023832c1 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:58.030982 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2ac8751b-7e7f-4420-9c1f-5548023832c1 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:58.031423 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2ac8751b-7e7f-4420-9c1f-5548023832c1 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:58.189169 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-365f85ad-7a5f-4a44-8408-53a8c0dd19ab tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023704e9bd7e4bfcace7a3fa2ec9d919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450ff0f7a98a4ae385a74e4ddaf301ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:58.197714 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-365f85ad-7a5f-4a44-8408-53a8c0dd19ab tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] 10.222.0.25 "GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f" status: 200 len: 1260 microversion: 2.1 time: 0.273971 May 27 03:43:58.198348 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 292/545] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:57 2021] GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f => generated 1260 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:58.202812 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-b5d800fa-e7ba-4f18-aa36-730be7ea4ac1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:58.206208 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-b5d800fa-e7ba-4f18-aa36-730be7ea4ac1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:58.210661 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b5d800fa-e7ba-4f18-aa36-730be7ea4ac1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:58.211105 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b5d800fa-e7ba-4f18-aa36-730be7ea4ac1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:58.211906 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b5d800fa-e7ba-4f18-aa36-730be7ea4ac1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:58.212341 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b5d800fa-e7ba-4f18-aa36-730be7ea4ac1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:58.321355 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-b5d800fa-e7ba-4f18-aa36-730be7ea4ac1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 28693 microversion: 2.20 time: 0.121720 May 27 03:43:58.322002 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 293/546] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:43:58 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 28693 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:43:58.329576 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-6d0718c8-2f9a-4c82-8740-a3402cd9cd97 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:58.330579 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-6d0718c8-2f9a-4c82-8740-a3402cd9cd97 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:58.338036 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6d0718c8-2f9a-4c82-8740-a3402cd9cd97 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:58.338531 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6d0718c8-2f9a-4c82-8740-a3402cd9cd97 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:58.339381 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6d0718c8-2f9a-4c82-8740-a3402cd9cd97 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:58.339721 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6d0718c8-2f9a-4c82-8740-a3402cd9cd97 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:58.459545 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-6d0718c8-2f9a-4c82-8740-a3402cd9cd97 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28701 microversion: 2.1 time: 0.135894 May 27 03:43:58.461133 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 294/547] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:43:58 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28701 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:43:58.635498 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-2ac8751b-7e7f-4420-9c1f-5548023832c1 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:58.643844 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-2ac8751b-7e7f-4420-9c1f-5548023832c1 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/7caeff19-8b2a-4c81-b6f2-1178b3f1a561" status: 200 len: 1513 microversion: 2.1 time: 0.633929 May 27 03:43:58.653568 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 254/548] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:58 2021] GET /compute/v2.1/servers/7caeff19-8b2a-4c81-b6f2-1178b3f1a561 => generated 1513 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:59.216750 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-09b434a1-3a34-4687-88a5-1997a93325ec tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:59.218034 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-09b434a1-3a34-4687-88a5-1997a93325ec tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] [instance: 02984890-fe33-4d25-bf6d-a3c3163a965f] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:59.236605 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-09b434a1-3a34-4687-88a5-1997a93325ec tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:59.237689 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-09b434a1-3a34-4687-88a5-1997a93325ec tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:59.238867 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-09b434a1-3a34-4687-88a5-1997a93325ec tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:59.240204 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-09b434a1-3a34-4687-88a5-1997a93325ec tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:59.335161 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-59ac07b1-0dfc-445b-ac1b-4b214040329b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:59.336448 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-59ac07b1-0dfc-445b-ac1b-4b214040329b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:59.351247 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-59ac07b1-0dfc-445b-ac1b-4b214040329b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:59.353545 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-59ac07b1-0dfc-445b-ac1b-4b214040329b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:59.355097 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-59ac07b1-0dfc-445b-ac1b-4b214040329b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:59.356777 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-59ac07b1-0dfc-445b-ac1b-4b214040329b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:59.556886 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-59ac07b1-0dfc-445b-ac1b-4b214040329b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 28693 microversion: 2.20 time: 0.225477 May 27 03:43:59.558633 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 255/549] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:43:59 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 28693 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 27 03:43:59.564745 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [req-4d2cd39d-a1b2-4561-9b48-abb610d5db75 req-b7373029-58fa-4422-9345-0b96126c3ab4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7caeff19-8b2a-4c81-b6f2-1178b3f1a561", "name": "network-vif-deleted", "tag": "c4a2f300-3a9c-46a1-a78d-8b27643ba00e"}]} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:59.566603 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-09b434a1-3a34-4687-88a5-1997a93325ec tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023704e9bd7e4bfcace7a3fa2ec9d919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450ff0f7a98a4ae385a74e4ddaf301ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:43:59.576932 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-09b434a1-3a34-4687-88a5-1997a93325ec tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] 10.222.0.25 "GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f" status: 200 len: 1260 microversion: 2.1 time: 0.365734 May 27 03:43:59.579586 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 295/550] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:59 2021] GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f => generated 1260 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:43:59.581014 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:43:59.581014 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: warnings.warn(msg) May 27 03:43:59.587402 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-d724c57a-7b53-4ef8-9821-54c8dd09a40a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:43:59.588820 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-d724c57a-7b53-4ef8-9821-54c8dd09a40a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:59.597924 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d724c57a-7b53-4ef8-9821-54c8dd09a40a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:59.598539 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d724c57a-7b53-4ef8-9821-54c8dd09a40a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:59.599701 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d724c57a-7b53-4ef8-9821-54c8dd09a40a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:59.600332 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d724c57a-7b53-4ef8-9821-54c8dd09a40a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:59.603526 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-4d2cd39d-a1b2-4561-9b48-abb610d5db75 req-b7373029-58fa-4422-9345-0b96126c3ab4 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:59.605436 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-4d2cd39d-a1b2-4561-9b48-abb610d5db75 req-b7373029-58fa-4422-9345-0b96126c3ab4 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:59.782330 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-d724c57a-7b53-4ef8-9821-54c8dd09a40a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28701 microversion: 2.1 time: 0.200771 May 27 03:43:59.783079 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 296/551] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:43:59 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28701 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:43:59.798497 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-4c52013d-d7fe-46b4-99fe-5782aa69d9d2 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:59.799258 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-4c52013d-d7fe-46b4-99fe-5782aa69d9d2 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: e3449057-b2c6-4b15-b705-4076eddfefff] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:59.822122 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4c52013d-d7fe-46b4-99fe-5782aa69d9d2 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:59.822856 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4c52013d-d7fe-46b4-99fe-5782aa69d9d2 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:59.826719 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4c52013d-d7fe-46b4-99fe-5782aa69d9d2 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:59.827473 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4c52013d-d7fe-46b4-99fe-5782aa69d9d2 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:59.927810 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-4c52013d-d7fe-46b4-99fe-5782aa69d9d2 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: e3449057-b2c6-4b15-b705-4076eddfefff] Going to try to terminate instance {{(pid=113020) delete /opt/stack/nova/nova/compute/api.py:2539}} May 27 03:43:59.932512 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.compute.server_external_events [req-4d2cd39d-a1b2-4561-9b48-abb610d5db75 req-b7373029-58fa-4422-9345-0b96126c3ab4 service nova] Creating event network-vif-deleted:c4a2f300-3a9c-46a1-a78d-8b27643ba00e for instance 7caeff19-8b2a-4c81-b6f2-1178b3f1a561 on hv-cinder-79326 May 27 03:43:59.938712 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [req-4d2cd39d-a1b2-4561-9b48-abb610d5db75 req-b7373029-58fa-4422-9345-0b96126c3ab4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.377664 May 27 03:43:59.939789 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 256/552] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:43:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:43:59.945756 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-e2c88d75-725d-414e-988c-dce85b18cfed tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:43:59.946589 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-e2c88d75-725d-414e-988c-dce85b18cfed tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 7caeff19-8b2a-4c81-b6f2-1178b3f1a561] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:43:59.955139 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e2c88d75-725d-414e-988c-dce85b18cfed tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:59.955732 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e2c88d75-725d-414e-988c-dce85b18cfed tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:43:59.956660 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e2c88d75-725d-414e-988c-dce85b18cfed tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:43:59.957291 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e2c88d75-725d-414e-988c-dce85b18cfed tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:00.069171 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e2c88d75-725d-414e-988c-dce85b18cfed tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:00.070279 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e2c88d75-725d-414e-988c-dce85b18cfed tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:00.070759 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.objects.instance [None req-e2c88d75-725d-414e-988c-dce85b18cfed tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lazy-loading 'fault' on Instance uuid 7caeff19-8b2a-4c81-b6f2-1178b3f1a561 {{(pid=113021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 27 03:44:00.323429 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-4c52013d-d7fe-46b4-99fe-5782aa69d9d2 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff" status: 204 len: 0 microversion: 2.1 time: 0.534182 May 27 03:44:00.324277 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 297/553] 10.222.0.25 () {58 vars in 1239 bytes} [Thu May 27 03:43:59 2021] DELETE /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff => generated 0 bytes in 536 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 03:44:00.328806 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-e2c88d75-725d-414e-988c-dce85b18cfed tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:00.332313 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-f167a674-4042-4a67-a0be-e4d510b9c3ec tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:00.333047 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-f167a674-4042-4a67-a0be-e4d510b9c3ec tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: e3449057-b2c6-4b15-b705-4076eddfefff] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:00.338850 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-e2c88d75-725d-414e-988c-dce85b18cfed tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/7caeff19-8b2a-4c81-b6f2-1178b3f1a561" status: 200 len: 1307 microversion: 2.1 time: 0.397382 May 27 03:44:00.348270 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 257/554] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:43:59 2021] GET /compute/v2.1/servers/7caeff19-8b2a-4c81-b6f2-1178b3f1a561 => generated 1307 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:00.356910 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f167a674-4042-4a67-a0be-e4d510b9c3ec tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:00.360209 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f167a674-4042-4a67-a0be-e4d510b9c3ec tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:00.360209 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f167a674-4042-4a67-a0be-e4d510b9c3ec tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:00.360796 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f167a674-4042-4a67-a0be-e4d510b9c3ec tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:00.570478 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-0680a3d5-b25c-4ee7-a2f6-41f3ddac5e08 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:44:00.576061 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-0680a3d5-b25c-4ee7-a2f6-41f3ddac5e08 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:00.579524 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-0680a3d5-b25c-4ee7-a2f6-41f3ddac5e08 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:00.580102 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-0680a3d5-b25c-4ee7-a2f6-41f3ddac5e08 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:00.581015 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-0680a3d5-b25c-4ee7-a2f6-41f3ddac5e08 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:00.581652 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-0680a3d5-b25c-4ee7-a2f6-41f3ddac5e08 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:00.609037 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-f167a674-4042-4a67-a0be-e4d510b9c3ec tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:00.619220 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-f167a674-4042-4a67-a0be-e4d510b9c3ec tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff" status: 200 len: 1509 microversion: 2.1 time: 0.290876 May 27 03:44:00.620100 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 298/555] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:44:00 2021] GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff => generated 1509 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:00.625228 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-ea2a81b6-05cb-4fa2-8113-989b1c1ba6e8 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:00.626063 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-ea2a81b6-05cb-4fa2-8113-989b1c1ba6e8 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] [instance: 02984890-fe33-4d25-bf6d-a3c3163a965f] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:00.634722 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ea2a81b6-05cb-4fa2-8113-989b1c1ba6e8 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:00.635895 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ea2a81b6-05cb-4fa2-8113-989b1c1ba6e8 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:00.637891 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ea2a81b6-05cb-4fa2-8113-989b1c1ba6e8 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:00.638804 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ea2a81b6-05cb-4fa2-8113-989b1c1ba6e8 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:00.845384 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-0680a3d5-b25c-4ee7-a2f6-41f3ddac5e08 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 28693 microversion: 2.20 time: 0.278302 May 27 03:44:00.851597 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 258/556] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:44:00 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 28693 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 27 03:44:00.855006 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-244c15e7-6b1b-4498-b182-fb174a0f592b tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:44:00.857244 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-244c15e7-6b1b-4498-b182-fb174a0f592b tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:00.885895 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-244c15e7-6b1b-4498-b182-fb174a0f592b tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:00.888440 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-244c15e7-6b1b-4498-b182-fb174a0f592b tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:00.901586 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-244c15e7-6b1b-4498-b182-fb174a0f592b tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:00.904319 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-244c15e7-6b1b-4498-b182-fb174a0f592b tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:01.023530 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-ea2a81b6-05cb-4fa2-8113-989b1c1ba6e8 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023704e9bd7e4bfcace7a3fa2ec9d919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450ff0f7a98a4ae385a74e4ddaf301ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:01.032177 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-ea2a81b6-05cb-4fa2-8113-989b1c1ba6e8 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] 10.222.0.25 "GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f" status: 200 len: 1260 microversion: 2.1 time: 0.410652 May 27 03:44:01.032818 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 299/557] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:44:00 2021] GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f => generated 1260 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:01.053510 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-244c15e7-6b1b-4498-b182-fb174a0f592b tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28701 microversion: 2.1 time: 0.205502 May 27 03:44:01.057500 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 259/558] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:44:00 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28701 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:44:01.355467 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-3c4c7075-c384-47d7-92c5-741d6a859f41 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:01.360264 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-3c4c7075-c384-47d7-92c5-741d6a859f41 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 7caeff19-8b2a-4c81-b6f2-1178b3f1a561] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:01.364984 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3c4c7075-c384-47d7-92c5-741d6a859f41 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:01.365443 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3c4c7075-c384-47d7-92c5-741d6a859f41 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:01.366241 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3c4c7075-c384-47d7-92c5-741d6a859f41 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:01.366664 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3c4c7075-c384-47d7-92c5-741d6a859f41 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:01.420555 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.wsgi [None req-3c4c7075-c384-47d7-92c5-741d6a859f41 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] HTTP exception thrown: Instance 7caeff19-8b2a-4c81-b6f2-1178b3f1a561 could not be found. May 27 03:44:01.421217 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-3c4c7075-c384-47d7-92c5-741d6a859f41 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Returning 404 to user: Instance 7caeff19-8b2a-4c81-b6f2-1178b3f1a561 could not be found. {{(pid=113020) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 27 03:44:01.422608 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-3c4c7075-c384-47d7-92c5-741d6a859f41 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/7caeff19-8b2a-4c81-b6f2-1178b3f1a561" status: 404 len: 111 microversion: 2.1 time: 0.070694 May 27 03:44:01.423453 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 300/559] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:44:01 2021] GET /compute/v2.1/servers/7caeff19-8b2a-4c81-b6f2-1178b3f1a561 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:44:01.639362 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-ecb625e0-98c3-40eb-a308-13eb01e655cc tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:01.641155 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-ecb625e0-98c3-40eb-a308-13eb01e655cc tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: e3449057-b2c6-4b15-b705-4076eddfefff] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:01.664077 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ecb625e0-98c3-40eb-a308-13eb01e655cc tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:01.665025 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ecb625e0-98c3-40eb-a308-13eb01e655cc tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:01.665891 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ecb625e0-98c3-40eb-a308-13eb01e655cc tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:01.666404 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ecb625e0-98c3-40eb-a308-13eb01e655cc tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:01.858064 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-010fd3e1-a10f-420f-abc9-b52a853ff7f6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:44:01.859097 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-010fd3e1-a10f-420f-abc9-b52a853ff7f6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:01.867424 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-010fd3e1-a10f-420f-abc9-b52a853ff7f6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:01.867878 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-010fd3e1-a10f-420f-abc9-b52a853ff7f6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:01.868686 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-010fd3e1-a10f-420f-abc9-b52a853ff7f6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:01.869118 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-010fd3e1-a10f-420f-abc9-b52a853ff7f6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:01.975341 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-010fd3e1-a10f-420f-abc9-b52a853ff7f6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 28693 microversion: 2.20 time: 0.121061 May 27 03:44:01.976238 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 301/560] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:44:01 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 28693 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 27 03:44:02.049890 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-9ad62a99-777c-4cad-b738-e226c6974218 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:02.050967 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-9ad62a99-777c-4cad-b738-e226c6974218 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] [instance: 02984890-fe33-4d25-bf6d-a3c3163a965f] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:02.059156 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9ad62a99-777c-4cad-b738-e226c6974218 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:02.059656 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9ad62a99-777c-4cad-b738-e226c6974218 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:02.060781 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9ad62a99-777c-4cad-b738-e226c6974218 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:02.061220 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9ad62a99-777c-4cad-b738-e226c6974218 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:02.191053 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-ecb625e0-98c3-40eb-a308-13eb01e655cc tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:02.216171 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-ecb625e0-98c3-40eb-a308-13eb01e655cc tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff" status: 200 len: 1509 microversion: 2.1 time: 0.580858 May 27 03:44:02.217199 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 260/561] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:44:01 2021] GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff => generated 1509 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:02.230297 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-144a0555-16a4-4113-897b-0632a51576be tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:44:02.231446 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-144a0555-16a4-4113-897b-0632a51576be tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:02.253010 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-144a0555-16a4-4113-897b-0632a51576be tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:02.257372 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-144a0555-16a4-4113-897b-0632a51576be tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:02.258521 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-144a0555-16a4-4113-897b-0632a51576be tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:02.259182 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-144a0555-16a4-4113-897b-0632a51576be tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:02.275654 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-9ad62a99-777c-4cad-b738-e226c6974218 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023704e9bd7e4bfcace7a3fa2ec9d919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450ff0f7a98a4ae385a74e4ddaf301ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:02.289283 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-9ad62a99-777c-4cad-b738-e226c6974218 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] 10.222.0.25 "GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f" status: 200 len: 1260 microversion: 2.1 time: 0.243266 May 27 03:44:02.299786 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 302/562] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:44:02 2021] GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f => generated 1260 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:02.395338 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-144a0555-16a4-4113-897b-0632a51576be tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28701 microversion: 2.1 time: 0.176496 May 27 03:44:02.399295 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 261/563] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:44:02 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28701 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:44:02.838917 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-b081c105-637d-4edc-bca3-e2d2507b27d0 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:02.839517 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-b081c105-637d-4edc-bca3-e2d2507b27d0 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 6ad4e5b6-865b-4cda-ade3-c3eb357ec57e] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:02.846970 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b081c105-637d-4edc-bca3-e2d2507b27d0 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:02.847819 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b081c105-637d-4edc-bca3-e2d2507b27d0 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:02.849320 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b081c105-637d-4edc-bca3-e2d2507b27d0 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:02.850095 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b081c105-637d-4edc-bca3-e2d2507b27d0 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:02.918815 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-b081c105-637d-4edc-bca3-e2d2507b27d0 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 6ad4e5b6-865b-4cda-ade3-c3eb357ec57e] Going to try to terminate instance {{(pid=113020) delete /opt/stack/nova/nova/compute/api.py:2539}} May 27 03:44:02.988522 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-f2478bbd-7749-4b5e-812d-6dcf909b2696 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:44:02.992160 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-f2478bbd-7749-4b5e-812d-6dcf909b2696 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:02.998528 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f2478bbd-7749-4b5e-812d-6dcf909b2696 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:02.998976 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f2478bbd-7749-4b5e-812d-6dcf909b2696 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:03.000158 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f2478bbd-7749-4b5e-812d-6dcf909b2696 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:03.000813 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f2478bbd-7749-4b5e-812d-6dcf909b2696 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:03.263782 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-f2478bbd-7749-4b5e-812d-6dcf909b2696 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 28693 microversion: 2.20 time: 0.279759 May 27 03:44:03.265644 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 262/564] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:44:02 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 28693 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 27 03:44:03.267927 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-b081c105-637d-4edc-bca3-e2d2507b27d0 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6ad4e5b6-865b-4cda-ade3-c3eb357ec57e" status: 204 len: 0 microversion: 2.1 time: 0.432632 May 27 03:44:03.270590 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 303/565] 10.222.0.25 () {58 vars in 1239 bytes} [Thu May 27 03:44:02 2021] DELETE /compute/v2.1/servers/6ad4e5b6-865b-4cda-ade3-c3eb357ec57e => generated 0 bytes in 435 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 27 03:44:03.272561 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-0147d3ed-f99a-4d96-afed-f80f611f61bc tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:03.273272 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-0147d3ed-f99a-4d96-afed-f80f611f61bc tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: e3449057-b2c6-4b15-b705-4076eddfefff] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:03.277082 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-ed093537-dfed-4dcc-94f5-1858a37085c1 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:03.278265 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-ed093537-dfed-4dcc-94f5-1858a37085c1 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 6ad4e5b6-865b-4cda-ade3-c3eb357ec57e] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:03.282071 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-0147d3ed-f99a-4d96-afed-f80f611f61bc tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:03.282714 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-0147d3ed-f99a-4d96-afed-f80f611f61bc tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:03.283660 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-0147d3ed-f99a-4d96-afed-f80f611f61bc tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:03.284276 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-0147d3ed-f99a-4d96-afed-f80f611f61bc tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:03.288391 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ed093537-dfed-4dcc-94f5-1858a37085c1 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:03.289894 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ed093537-dfed-4dcc-94f5-1858a37085c1 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:03.290820 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ed093537-dfed-4dcc-94f5-1858a37085c1 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:03.291262 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ed093537-dfed-4dcc-94f5-1858a37085c1 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:03.558036 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-ed093537-dfed-4dcc-94f5-1858a37085c1 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:03.572242 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-ed093537-dfed-4dcc-94f5-1858a37085c1 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/6ad4e5b6-865b-4cda-ade3-c3eb357ec57e" status: 200 len: 1515 microversion: 2.1 time: 0.293871 May 27 03:44:03.576986 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 304/566] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:44:03 2021] GET /compute/v2.1/servers/6ad4e5b6-865b-4cda-ade3-c3eb357ec57e => generated 1515 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:03.583049 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-d48d5a6d-71e2-4376-8318-2f54106ef17e tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:03.583820 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-d48d5a6d-71e2-4376-8318-2f54106ef17e tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] [instance: 02984890-fe33-4d25-bf6d-a3c3163a965f] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:03.598250 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d48d5a6d-71e2-4376-8318-2f54106ef17e tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:03.599678 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d48d5a6d-71e2-4376-8318-2f54106ef17e tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:03.603327 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d48d5a6d-71e2-4376-8318-2f54106ef17e tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:03.604032 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d48d5a6d-71e2-4376-8318-2f54106ef17e tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:03.657955 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-0147d3ed-f99a-4d96-afed-f80f611f61bc tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:03.669901 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-0147d3ed-f99a-4d96-afed-f80f611f61bc tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff" status: 200 len: 1509 microversion: 2.1 time: 0.402931 May 27 03:44:03.670488 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 263/567] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:44:03 2021] GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff => generated 1509 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:03.674984 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-414cdb01-8d71-474f-a2c2-bf7d834e772f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:44:03.675908 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-414cdb01-8d71-474f-a2c2-bf7d834e772f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:03.695069 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-414cdb01-8d71-474f-a2c2-bf7d834e772f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:03.695521 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-414cdb01-8d71-474f-a2c2-bf7d834e772f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:03.696310 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-414cdb01-8d71-474f-a2c2-bf7d834e772f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:03.696773 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-414cdb01-8d71-474f-a2c2-bf7d834e772f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:03.808283 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-414cdb01-8d71-474f-a2c2-bf7d834e772f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28701 microversion: 2.1 time: 0.136087 May 27 03:44:03.809667 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 264/568] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:44:03 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28701 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:44:04.100742 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-d48d5a6d-71e2-4376-8318-2f54106ef17e tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023704e9bd7e4bfcace7a3fa2ec9d919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450ff0f7a98a4ae385a74e4ddaf301ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:04.110168 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-d48d5a6d-71e2-4376-8318-2f54106ef17e tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] 10.222.0.25 "GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f" status: 200 len: 1260 microversion: 2.1 time: 0.530744 May 27 03:44:04.111841 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 305/569] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:44:03 2021] GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f => generated 1260 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:04.285689 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-36ac0f0e-227d-451a-be81-c92343217820 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:44:04.288436 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-36ac0f0e-227d-451a-be81-c92343217820 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:04.315866 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-36ac0f0e-227d-451a-be81-c92343217820 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:04.317274 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-36ac0f0e-227d-451a-be81-c92343217820 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:04.318347 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-36ac0f0e-227d-451a-be81-c92343217820 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:04.319030 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-36ac0f0e-227d-451a-be81-c92343217820 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:04.387784 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [req-6566a370-d50d-4833-9ae7-f0a37656f638 req-b9dedb39-d067-42dd-88ed-eb20248b6b9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3449057-b2c6-4b15-b705-4076eddfefff", "name": "network-vif-deleted", "tag": "b78c21a4-6cab-4194-9f32-cbe141d6578d"}]} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:44:04.389979 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:44:04.389979 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: warnings.warn(msg) May 27 03:44:04.401522 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-6566a370-d50d-4833-9ae7-f0a37656f638 req-b9dedb39-d067-42dd-88ed-eb20248b6b9d service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:04.402833 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-6566a370-d50d-4833-9ae7-f0a37656f638 req-b9dedb39-d067-42dd-88ed-eb20248b6b9d service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:04.433123 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.compute.server_external_events [req-6566a370-d50d-4833-9ae7-f0a37656f638 req-b9dedb39-d067-42dd-88ed-eb20248b6b9d service nova] Creating event network-vif-deleted:b78c21a4-6cab-4194-9f32-cbe141d6578d for instance e3449057-b2c6-4b15-b705-4076eddfefff on hv-cinder-79326 May 27 03:44:04.439299 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [req-6566a370-d50d-4833-9ae7-f0a37656f638 req-b9dedb39-d067-42dd-88ed-eb20248b6b9d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055331 May 27 03:44:04.442203 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 306/570] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:44:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:44:04.484791 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-36ac0f0e-227d-451a-be81-c92343217820 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 28693 microversion: 2.20 time: 0.210360 May 27 03:44:04.489470 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 265/571] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:44:04 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 28693 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:44:04.599076 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-0aaa8443-346c-4a32-8f7d-52def7aceff4 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:04.600669 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-0aaa8443-346c-4a32-8f7d-52def7aceff4 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 6ad4e5b6-865b-4cda-ade3-c3eb357ec57e] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:04.610203 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0aaa8443-346c-4a32-8f7d-52def7aceff4 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:04.610831 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0aaa8443-346c-4a32-8f7d-52def7aceff4 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:04.611809 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0aaa8443-346c-4a32-8f7d-52def7aceff4 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:04.612485 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0aaa8443-346c-4a32-8f7d-52def7aceff4 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:04.688453 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-9e10e269-d07b-4e54-b6a2-f693bd6cbde6 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:04.689043 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-9e10e269-d07b-4e54-b6a2-f693bd6cbde6 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: e3449057-b2c6-4b15-b705-4076eddfefff] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:04.697625 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-9e10e269-d07b-4e54-b6a2-f693bd6cbde6 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:04.698087 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-9e10e269-d07b-4e54-b6a2-f693bd6cbde6 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:04.698870 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-9e10e269-d07b-4e54-b6a2-f693bd6cbde6 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:04.699311 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-9e10e269-d07b-4e54-b6a2-f693bd6cbde6 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:04.795829 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-9e10e269-d07b-4e54-b6a2-f693bd6cbde6 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:04.796633 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-9e10e269-d07b-4e54-b6a2-f693bd6cbde6 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:04.797304 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.objects.instance [None req-9e10e269-d07b-4e54-b6a2-f693bd6cbde6 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lazy-loading 'fault' on Instance uuid e3449057-b2c6-4b15-b705-4076eddfefff {{(pid=113021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 27 03:44:04.957396 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-0aaa8443-346c-4a32-8f7d-52def7aceff4 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:04.968282 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-9e10e269-d07b-4e54-b6a2-f693bd6cbde6 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:04.969472 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-0aaa8443-346c-4a32-8f7d-52def7aceff4 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/6ad4e5b6-865b-4cda-ade3-c3eb357ec57e" status: 200 len: 1515 microversion: 2.1 time: 0.380112 May 27 03:44:04.970280 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 307/572] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:44:04 2021] GET /compute/v2.1/servers/6ad4e5b6-865b-4cda-ade3-c3eb357ec57e => generated 1515 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:04.975514 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-329984fa-9c35-48dd-8a0f-d1fa59445895 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:44:04.976482 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-329984fa-9c35-48dd-8a0f-d1fa59445895 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:04.979466 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-9e10e269-d07b-4e54-b6a2-f693bd6cbde6 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff" status: 200 len: 1312 microversion: 2.1 time: 0.294013 May 27 03:44:04.983729 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-329984fa-9c35-48dd-8a0f-d1fa59445895 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:04.984736 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-329984fa-9c35-48dd-8a0f-d1fa59445895 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:04.985526 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-329984fa-9c35-48dd-8a0f-d1fa59445895 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:04.985970 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-329984fa-9c35-48dd-8a0f-d1fa59445895 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:04.993931 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 266/573] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:44:04 2021] GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff => generated 1312 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:44:05.127482 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-d847529a-1b56-4540-89b3-c07d93d8e2b1 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:05.128117 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-d847529a-1b56-4540-89b3-c07d93d8e2b1 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] [instance: 02984890-fe33-4d25-bf6d-a3c3163a965f] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:05.135271 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d847529a-1b56-4540-89b3-c07d93d8e2b1 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:05.135726 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d847529a-1b56-4540-89b3-c07d93d8e2b1 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:05.136534 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d847529a-1b56-4540-89b3-c07d93d8e2b1 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:05.136979 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d847529a-1b56-4540-89b3-c07d93d8e2b1 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:05.179522 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-329984fa-9c35-48dd-8a0f-d1fa59445895 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28701 microversion: 2.1 time: 0.207111 May 27 03:44:05.180537 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 308/574] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:44:04 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28701 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:44:05.365238 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-d847529a-1b56-4540-89b3-c07d93d8e2b1 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023704e9bd7e4bfcace7a3fa2ec9d919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450ff0f7a98a4ae385a74e4ddaf301ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:05.373794 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-d847529a-1b56-4540-89b3-c07d93d8e2b1 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] 10.222.0.25 "GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f" status: 200 len: 1260 microversion: 2.1 time: 0.250565 May 27 03:44:05.374559 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 267/575] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:44:05 2021] GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f => generated 1260 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:44:05.498431 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-46a041aa-0f7b-40ca-87ee-6fbafdc68ae3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:44:05.499520 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-46a041aa-0f7b-40ca-87ee-6fbafdc68ae3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:05.508675 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-46a041aa-0f7b-40ca-87ee-6fbafdc68ae3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:05.509264 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-46a041aa-0f7b-40ca-87ee-6fbafdc68ae3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:05.510214 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-46a041aa-0f7b-40ca-87ee-6fbafdc68ae3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:05.510752 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-46a041aa-0f7b-40ca-87ee-6fbafdc68ae3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:05.631936 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-46a041aa-0f7b-40ca-87ee-6fbafdc68ae3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 28693 microversion: 2.20 time: 0.137741 May 27 03:44:05.633438 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 309/576] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:44:05 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 28693 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:44:05.986189 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-32cb7cd4-9908-4d97-82c7-a41bef6aaa2c tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:05.986813 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-32cb7cd4-9908-4d97-82c7-a41bef6aaa2c tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 6ad4e5b6-865b-4cda-ade3-c3eb357ec57e] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:06.005172 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-17cc097b-7e11-49ce-af7f-ddfd9edc0587 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:06.006140 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-17cc097b-7e11-49ce-af7f-ddfd9edc0587 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: e3449057-b2c6-4b15-b705-4076eddfefff] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:06.013335 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-32cb7cd4-9908-4d97-82c7-a41bef6aaa2c tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:06.014045 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-32cb7cd4-9908-4d97-82c7-a41bef6aaa2c tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:06.016248 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-32cb7cd4-9908-4d97-82c7-a41bef6aaa2c tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:06.016879 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-32cb7cd4-9908-4d97-82c7-a41bef6aaa2c tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:06.020080 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-17cc097b-7e11-49ce-af7f-ddfd9edc0587 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:06.020574 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-17cc097b-7e11-49ce-af7f-ddfd9edc0587 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:06.021372 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-17cc097b-7e11-49ce-af7f-ddfd9edc0587 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:06.021817 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-17cc097b-7e11-49ce-af7f-ddfd9edc0587 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:06.152572 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.wsgi [None req-17cc097b-7e11-49ce-af7f-ddfd9edc0587 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] HTTP exception thrown: Instance e3449057-b2c6-4b15-b705-4076eddfefff could not be found. May 27 03:44:06.154724 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-17cc097b-7e11-49ce-af7f-ddfd9edc0587 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Returning 404 to user: Instance e3449057-b2c6-4b15-b705-4076eddfefff could not be found. {{(pid=113020) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 27 03:44:06.155839 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-17cc097b-7e11-49ce-af7f-ddfd9edc0587 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff" status: 404 len: 111 microversion: 2.1 time: 0.158065 May 27 03:44:06.162469 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 310/577] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:44:05 2021] GET /compute/v2.1/servers/e3449057-b2c6-4b15-b705-4076eddfefff => generated 111 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:44:06.180219 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-1eaa919f-0850-4314-a988-d86a59ef88db tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:06.181902 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-1eaa919f-0850-4314-a988-d86a59ef88db tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:06.194990 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1eaa919f-0850-4314-a988-d86a59ef88db tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:06.195780 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1eaa919f-0850-4314-a988-d86a59ef88db tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:06.196821 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1eaa919f-0850-4314-a988-d86a59ef88db tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:06.197523 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1eaa919f-0850-4314-a988-d86a59ef88db tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:06.311759 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-1eaa919f-0850-4314-a988-d86a59ef88db tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0] Going to try to terminate instance {{(pid=113020) delete /opt/stack/nova/nova/compute/api.py:2539}} May 27 03:44:06.633047 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-32cb7cd4-9908-4d97-82c7-a41bef6aaa2c tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:06.643960 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-32cb7cd4-9908-4d97-82c7-a41bef6aaa2c tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/6ad4e5b6-865b-4cda-ade3-c3eb357ec57e" status: 200 len: 1515 microversion: 2.1 time: 0.661663 May 27 03:44:06.645045 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 268/578] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:44:05 2021] GET /compute/v2.1/servers/6ad4e5b6-865b-4cda-ade3-c3eb357ec57e => generated 1515 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:06.649806 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-10aa5999-82f2-4607-879b-ce8f1d37df7a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:44:06.650782 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-10aa5999-82f2-4607-879b-ce8f1d37df7a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:06.659127 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-10aa5999-82f2-4607-879b-ce8f1d37df7a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:06.659809 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-10aa5999-82f2-4607-879b-ce8f1d37df7a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:06.660811 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-10aa5999-82f2-4607-879b-ce8f1d37df7a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:06.661597 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-10aa5999-82f2-4607-879b-ce8f1d37df7a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:06.772816 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-10aa5999-82f2-4607-879b-ce8f1d37df7a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 28701 microversion: 2.1 time: 0.126368 May 27 03:44:06.773641 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 269/579] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:44:06 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 28701 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:44:06.783072 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-ffdf67d8-4949-4dcf-a736-bd2f740f218d tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:06.783791 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-ffdf67d8-4949-4dcf-a736-bd2f740f218d tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] [instance: 02984890-fe33-4d25-bf6d-a3c3163a965f] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:06.793600 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ffdf67d8-4949-4dcf-a736-bd2f740f218d tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:06.794295 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ffdf67d8-4949-4dcf-a736-bd2f740f218d tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:06.795269 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ffdf67d8-4949-4dcf-a736-bd2f740f218d tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:06.796026 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ffdf67d8-4949-4dcf-a736-bd2f740f218d tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:06.867297 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-1eaa919f-0850-4314-a988-d86a59ef88db tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0" status: 204 len: 0 microversion: 2.1 time: 0.702944 May 27 03:44:06.867897 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 311/580] 10.222.0.25 () {58 vars in 1239 bytes} [Thu May 27 03:44:06 2021] DELETE /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0 => generated 0 bytes in 704 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 03:44:06.873106 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-20821a84-27a1-48b3-a172-5f0b0ac91ea6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:44:06.876788 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-20821a84-27a1-48b3-a172-5f0b0ac91ea6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:06.894532 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-20821a84-27a1-48b3-a172-5f0b0ac91ea6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:06.894992 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-20821a84-27a1-48b3-a172-5f0b0ac91ea6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:06.895789 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-20821a84-27a1-48b3-a172-5f0b0ac91ea6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:06.896236 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-20821a84-27a1-48b3-a172-5f0b0ac91ea6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:07.069090 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-20821a84-27a1-48b3-a172-5f0b0ac91ea6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 28862 microversion: 2.20 time: 0.199631 May 27 03:44:07.074142 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 312/581] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:44:06 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 28862 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:44:07.081653 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-bae44264-1af6-4449-bc50-6883c907ac0d tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:07.087558 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-bae44264-1af6-4449-bc50-6883c907ac0d tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:07.106268 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-bae44264-1af6-4449-bc50-6883c907ac0d tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:07.106970 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-bae44264-1af6-4449-bc50-6883c907ac0d tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:07.108059 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-bae44264-1af6-4449-bc50-6883c907ac0d tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:07.108695 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-bae44264-1af6-4449-bc50-6883c907ac0d tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:07.204820 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-ffdf67d8-4949-4dcf-a736-bd2f740f218d tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023704e9bd7e4bfcace7a3fa2ec9d919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450ff0f7a98a4ae385a74e4ddaf301ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:07.219286 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-ffdf67d8-4949-4dcf-a736-bd2f740f218d tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] 10.222.0.25 "GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f" status: 200 len: 1260 microversion: 2.1 time: 0.437709 May 27 03:44:07.219286 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 270/582] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:44:06 2021] GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f => generated 1260 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:07.241095 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [req-f11265b9-1620-4f82-b36c-9b6d7c0ccfff req-872db241-7e2a-45ee-a4f2-28435eafbcaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ad4e5b6-865b-4cda-ade3-c3eb357ec57e", "name": "network-vif-deleted", "tag": "5c2e4b9a-b01a-446c-b193-369cb4a1319e"}]} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:44:07.242907 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:44:07.242907 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: warnings.warn(msg) May 27 03:44:07.263915 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-f11265b9-1620-4f82-b36c-9b6d7c0ccfff req-872db241-7e2a-45ee-a4f2-28435eafbcaf service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:07.264253 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-f11265b9-1620-4f82-b36c-9b6d7c0ccfff req-872db241-7e2a-45ee-a4f2-28435eafbcaf service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:07.289256 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.compute.server_external_events [req-f11265b9-1620-4f82-b36c-9b6d7c0ccfff req-872db241-7e2a-45ee-a4f2-28435eafbcaf service nova] Creating event network-vif-deleted:5c2e4b9a-b01a-446c-b193-369cb4a1319e for instance 6ad4e5b6-865b-4cda-ade3-c3eb357ec57e on hv-cinder-79326 May 27 03:44:07.297130 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [req-f11265b9-1620-4f82-b36c-9b6d7c0ccfff req-872db241-7e2a-45ee-a4f2-28435eafbcaf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064187 May 27 03:44:07.300710 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 271/583] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:44:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:44:07.512039 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [req-5e2e11b5-ef06-40a4-a450-7a1448fdfbbb req-3b7b98da-88b7-4bcf-b4e0-8a1c43712f77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02984890-fe33-4d25-bf6d-a3c3163a965f", "name": "network-vif-plugged", "status": "completed", "tag": "2554297d-a794-4bc9-9cb3-56dce4e9fb2f"}]} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:44:07.513597 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:44:07.513597 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: warnings.warn(msg) May 27 03:44:07.522043 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-5e2e11b5-ef06-40a4-a450-7a1448fdfbbb req-3b7b98da-88b7-4bcf-b4e0-8a1c43712f77 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:07.522563 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-5e2e11b5-ef06-40a4-a450-7a1448fdfbbb req-3b7b98da-88b7-4bcf-b4e0-8a1c43712f77 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:07.540028 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.compute.server_external_events [req-5e2e11b5-ef06-40a4-a450-7a1448fdfbbb req-3b7b98da-88b7-4bcf-b4e0-8a1c43712f77 service nova] Creating event network-vif-plugged:2554297d-a794-4bc9-9cb3-56dce4e9fb2f for instance 02984890-fe33-4d25-bf6d-a3c3163a965f on hv-cinder-79326 May 27 03:44:07.544113 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [req-5e2e11b5-ef06-40a4-a450-7a1448fdfbbb req-3b7b98da-88b7-4bcf-b4e0-8a1c43712f77 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036102 May 27 03:44:07.544952 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 272/584] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:44:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:44:07.549392 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-bae44264-1af6-4449-bc50-6883c907ac0d tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:07.557578 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-bae44264-1af6-4449-bc50-6883c907ac0d tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0" status: 200 len: 1523 microversion: 2.1 time: 0.481536 May 27 03:44:07.558151 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 313/585] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:44:07 2021] GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0 => generated 1523 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:07.662213 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-4cf05f40-35a9-404b-9230-e11975d49491 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:07.663173 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-4cf05f40-35a9-404b-9230-e11975d49491 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 6ad4e5b6-865b-4cda-ade3-c3eb357ec57e] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:07.671452 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-4cf05f40-35a9-404b-9230-e11975d49491 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:07.674970 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-4cf05f40-35a9-404b-9230-e11975d49491 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:07.696462 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-4cf05f40-35a9-404b-9230-e11975d49491 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:07.696462 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-4cf05f40-35a9-404b-9230-e11975d49491 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:07.758773 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-4cf05f40-35a9-404b-9230-e11975d49491 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:07.759228 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-4cf05f40-35a9-404b-9230-e11975d49491 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:07.759730 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.objects.instance [None req-4cf05f40-35a9-404b-9230-e11975d49491 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lazy-loading 'fault' on Instance uuid 6ad4e5b6-865b-4cda-ade3-c3eb357ec57e {{(pid=113021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 27 03:44:07.788525 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-5adb721a-2385-42be-84ec-8f8e09cabbe4 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:44:07.790264 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-5adb721a-2385-42be-84ec-8f8e09cabbe4 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:07.811597 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-5adb721a-2385-42be-84ec-8f8e09cabbe4 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:07.814453 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-5adb721a-2385-42be-84ec-8f8e09cabbe4 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:07.821671 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-5adb721a-2385-42be-84ec-8f8e09cabbe4 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:07.823803 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-5adb721a-2385-42be-84ec-8f8e09cabbe4 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:07.912802 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-4cf05f40-35a9-404b-9230-e11975d49491 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:07.922112 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-4cf05f40-35a9-404b-9230-e11975d49491 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/6ad4e5b6-865b-4cda-ade3-c3eb357ec57e" status: 200 len: 1308 microversion: 2.1 time: 0.264451 May 27 03:44:07.923308 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 273/586] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:44:07 2021] GET /compute/v2.1/servers/6ad4e5b6-865b-4cda-ade3-c3eb357ec57e => generated 1308 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:07.957733 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-5adb721a-2385-42be-84ec-8f8e09cabbe4 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 29983 microversion: 2.1 time: 0.176772 May 27 03:44:07.959406 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 314/587] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:44:07 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 29983 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:44:08.087604 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-4b385deb-86ca-47f2-b84c-d1ab8af932dd tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:44:08.087604 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-4b385deb-86ca-47f2-b84c-d1ab8af932dd tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:08.114265 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-4b385deb-86ca-47f2-b84c-d1ab8af932dd tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:08.114762 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-4b385deb-86ca-47f2-b84c-d1ab8af932dd tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:08.115538 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-4b385deb-86ca-47f2-b84c-d1ab8af932dd tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:08.116047 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-4b385deb-86ca-47f2-b84c-d1ab8af932dd tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:08.234053 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-be7925bf-ce99-4984-82bb-2064fd361fe3 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:08.235606 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-be7925bf-ce99-4984-82bb-2064fd361fe3 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] [instance: 02984890-fe33-4d25-bf6d-a3c3163a965f] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:08.247700 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-be7925bf-ce99-4984-82bb-2064fd361fe3 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:08.248433 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-be7925bf-ce99-4984-82bb-2064fd361fe3 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:08.249486 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-be7925bf-ce99-4984-82bb-2064fd361fe3 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:08.249952 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-be7925bf-ce99-4984-82bb-2064fd361fe3 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:08.475768 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-4b385deb-86ca-47f2-b84c-d1ab8af932dd tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 30556 microversion: 2.20 time: 0.394519 May 27 03:44:08.476855 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 274/588] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:44:08 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 30556 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:44:08.575602 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-df1b30dd-64bc-426d-a96f-e3cfa22d8169 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:08.576308 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-df1b30dd-64bc-426d-a96f-e3cfa22d8169 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:08.586474 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-df1b30dd-64bc-426d-a96f-e3cfa22d8169 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:08.591146 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-df1b30dd-64bc-426d-a96f-e3cfa22d8169 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:08.591146 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-df1b30dd-64bc-426d-a96f-e3cfa22d8169 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:08.591146 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-df1b30dd-64bc-426d-a96f-e3cfa22d8169 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:08.711513 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-be7925bf-ce99-4984-82bb-2064fd361fe3 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023704e9bd7e4bfcace7a3fa2ec9d919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450ff0f7a98a4ae385a74e4ddaf301ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:08.721173 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-be7925bf-ce99-4984-82bb-2064fd361fe3 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] 10.222.0.25 "GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f" status: 200 len: 1260 microversion: 2.1 time: 0.491338 May 27 03:44:08.721861 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 315/589] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:44:08 2021] GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f => generated 1260 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:08.807968 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-df1b30dd-64bc-426d-a96f-e3cfa22d8169 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:08.817217 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-df1b30dd-64bc-426d-a96f-e3cfa22d8169 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0" status: 200 len: 1523 microversion: 2.1 time: 0.245579 May 27 03:44:08.818806 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 275/590] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:44:08 2021] GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0 => generated 1523 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:44:08.939703 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-f32ddc3c-5de7-4e11-8b64-e76b4a7755b5 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:08.940488 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-f32ddc3c-5de7-4e11-8b64-e76b4a7755b5 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 6ad4e5b6-865b-4cda-ade3-c3eb357ec57e] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:08.947841 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f32ddc3c-5de7-4e11-8b64-e76b4a7755b5 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:08.948290 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f32ddc3c-5de7-4e11-8b64-e76b4a7755b5 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:08.949144 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f32ddc3c-5de7-4e11-8b64-e76b4a7755b5 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:08.949691 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f32ddc3c-5de7-4e11-8b64-e76b4a7755b5 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:08.970059 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-69a0f938-62bb-4949-9ba9-70aed1bf4476 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:44:08.971705 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-69a0f938-62bb-4949-9ba9-70aed1bf4476 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:08.979624 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-69a0f938-62bb-4949-9ba9-70aed1bf4476 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:08.980474 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-69a0f938-62bb-4949-9ba9-70aed1bf4476 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:08.981467 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-69a0f938-62bb-4949-9ba9-70aed1bf4476 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:08.982255 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-69a0f938-62bb-4949-9ba9-70aed1bf4476 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:09.014160 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.wsgi [None req-f32ddc3c-5de7-4e11-8b64-e76b4a7755b5 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] HTTP exception thrown: Instance 6ad4e5b6-865b-4cda-ade3-c3eb357ec57e could not be found. May 27 03:44:09.015097 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-f32ddc3c-5de7-4e11-8b64-e76b4a7755b5 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Returning 404 to user: Instance 6ad4e5b6-865b-4cda-ade3-c3eb357ec57e could not be found. {{(pid=113020) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 27 03:44:09.016282 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-f32ddc3c-5de7-4e11-8b64-e76b4a7755b5 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/6ad4e5b6-865b-4cda-ade3-c3eb357ec57e" status: 404 len: 111 microversion: 2.1 time: 0.080102 May 27 03:44:09.017187 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 316/591] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:44:08 2021] GET /compute/v2.1/servers/6ad4e5b6-865b-4cda-ade3-c3eb357ec57e => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:44:09.024562 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-4bb41376-ffb8-457b-89f0-9ec9463e55f2 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:09.024871 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-4bb41376-ffb8-457b-89f0-9ec9463e55f2 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 6a78b67b-ae82-47f7-9c4a-3698918592c6] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:09.032103 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4bb41376-ffb8-457b-89f0-9ec9463e55f2 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:09.032580 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4bb41376-ffb8-457b-89f0-9ec9463e55f2 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:09.033351 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4bb41376-ffb8-457b-89f0-9ec9463e55f2 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:09.033785 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4bb41376-ffb8-457b-89f0-9ec9463e55f2 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:09.107139 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-4bb41376-ffb8-457b-89f0-9ec9463e55f2 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 6a78b67b-ae82-47f7-9c4a-3698918592c6] Going to try to terminate instance {{(pid=113020) delete /opt/stack/nova/nova/compute/api.py:2539}} May 27 03:44:09.155305 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-69a0f938-62bb-4949-9ba9-70aed1bf4476 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 31127 microversion: 2.1 time: 0.189460 May 27 03:44:09.156309 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 276/592] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:44:08 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 31127 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 03:44:09.488526 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-c12d7b9e-2c92-4d9c-bf76-42f6a66acc74 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:44:09.489913 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-c12d7b9e-2c92-4d9c-bf76-42f6a66acc74 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:09.498378 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c12d7b9e-2c92-4d9c-bf76-42f6a66acc74 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:09.502311 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c12d7b9e-2c92-4d9c-bf76-42f6a66acc74 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:09.502311 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c12d7b9e-2c92-4d9c-bf76-42f6a66acc74 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:09.502311 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c12d7b9e-2c92-4d9c-bf76-42f6a66acc74 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:09.554646 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-4bb41376-ffb8-457b-89f0-9ec9463e55f2 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "DELETE /compute/v2.1/servers/6a78b67b-ae82-47f7-9c4a-3698918592c6" status: 204 len: 0 microversion: 2.1 time: 0.532980 May 27 03:44:09.556781 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 317/593] 10.222.0.25 () {58 vars in 1239 bytes} [Thu May 27 03:44:09 2021] DELETE /compute/v2.1/servers/6a78b67b-ae82-47f7-9c4a-3698918592c6 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 27 03:44:09.568869 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-53a4c5c1-38fd-46f6-aa13-6ca2eee0f1ba tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:09.570171 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-53a4c5c1-38fd-46f6-aa13-6ca2eee0f1ba tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 6a78b67b-ae82-47f7-9c4a-3698918592c6] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:09.579112 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-53a4c5c1-38fd-46f6-aa13-6ca2eee0f1ba tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:09.579804 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-53a4c5c1-38fd-46f6-aa13-6ca2eee0f1ba tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:09.580814 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-53a4c5c1-38fd-46f6-aa13-6ca2eee0f1ba tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:09.581411 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-53a4c5c1-38fd-46f6-aa13-6ca2eee0f1ba tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:09.669394 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-c12d7b9e-2c92-4d9c-bf76-42f6a66acc74 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 31569 microversion: 2.20 time: 0.185067 May 27 03:44:09.670243 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 277/594] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:44:09 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 31569 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:44:09.739444 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-cf042223-313d-49b4-9647-992b2f03fc07 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:09.740417 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-cf042223-313d-49b4-9647-992b2f03fc07 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] [instance: 02984890-fe33-4d25-bf6d-a3c3163a965f] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:09.748565 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-cf042223-313d-49b4-9647-992b2f03fc07 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:09.749244 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-cf042223-313d-49b4-9647-992b2f03fc07 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:09.750289 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-cf042223-313d-49b4-9647-992b2f03fc07 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:09.750725 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-cf042223-313d-49b4-9647-992b2f03fc07 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:09.965714 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-cf042223-313d-49b4-9647-992b2f03fc07 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023704e9bd7e4bfcace7a3fa2ec9d919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450ff0f7a98a4ae385a74e4ddaf301ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:09.977039 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-cf042223-313d-49b4-9647-992b2f03fc07 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] 10.222.0.25 "GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f" status: 200 len: 1445 microversion: 2.1 time: 0.242820 May 27 03:44:09.978161 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 278/595] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:44:09 2021] GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f => generated 1445 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:44:09.983122 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-ce9a014f-f438-4b4c-a4a0-f2efa3a7d7e1 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:09.984573 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-ce9a014f-f438-4b4c-a4a0-f2efa3a7d7e1 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:09.993679 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ce9a014f-f438-4b4c-a4a0-f2efa3a7d7e1 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:09.994393 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ce9a014f-f438-4b4c-a4a0-f2efa3a7d7e1 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:09.995820 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ce9a014f-f438-4b4c-a4a0-f2efa3a7d7e1 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:09.996461 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ce9a014f-f438-4b4c-a4a0-f2efa3a7d7e1 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:10.008283 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-53a4c5c1-38fd-46f6-aa13-6ca2eee0f1ba tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:10.024158 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-53a4c5c1-38fd-46f6-aa13-6ca2eee0f1ba tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/6a78b67b-ae82-47f7-9c4a-3698918592c6" status: 200 len: 1515 microversion: 2.1 time: 0.462276 May 27 03:44:10.031715 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 318/596] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:44:09 2021] GET /compute/v2.1/servers/6a78b67b-ae82-47f7-9c4a-3698918592c6 => generated 1515 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:10.036839 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-16c1020f-2024-433d-856b-b3f340fc00e1 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:10.037622 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-16c1020f-2024-433d-856b-b3f340fc00e1 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] [instance: 02984890-fe33-4d25-bf6d-a3c3163a965f] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:10.057626 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-16c1020f-2024-433d-856b-b3f340fc00e1 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:10.060586 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-16c1020f-2024-433d-856b-b3f340fc00e1 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:10.060586 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-16c1020f-2024-433d-856b-b3f340fc00e1 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:10.060586 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-16c1020f-2024-433d-856b-b3f340fc00e1 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:10.252670 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-ce9a014f-f438-4b4c-a4a0-f2efa3a7d7e1 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:10.266188 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-ce9a014f-f438-4b4c-a4a0-f2efa3a7d7e1 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0" status: 200 len: 1523 microversion: 2.1 time: 0.286276 May 27 03:44:10.267011 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 279/597] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:44:09 2021] GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0 => generated 1523 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:10.283589 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-a015c973-7111-4477-aa93-1269888e7115 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:44:10.284854 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-a015c973-7111-4477-aa93-1269888e7115 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:10.295075 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a015c973-7111-4477-aa93-1269888e7115 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:10.295724 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a015c973-7111-4477-aa93-1269888e7115 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:10.296737 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a015c973-7111-4477-aa93-1269888e7115 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:10.297713 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a015c973-7111-4477-aa93-1269888e7115 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:10.415510 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-a015c973-7111-4477-aa93-1269888e7115 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 32192 microversion: 2.1 time: 0.137142 May 27 03:44:10.416249 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 280/598] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:44:10 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 32192 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:44:10.455375 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-16c1020f-2024-433d-856b-b3f340fc00e1 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023704e9bd7e4bfcace7a3fa2ec9d919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450ff0f7a98a4ae385a74e4ddaf301ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:10.466376 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-16c1020f-2024-433d-856b-b3f340fc00e1 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] 10.222.0.25 "GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f" status: 200 len: 1445 microversion: 2.1 time: 0.433090 May 27 03:44:10.467537 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 319/599] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:44:10 2021] GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f => generated 1445 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:10.681684 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-dd7aea8e-c0a0-438b-a255-0d1ddb1420df tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:44:10.683115 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-dd7aea8e-c0a0-438b-a255-0d1ddb1420df tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:10.692512 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-dd7aea8e-c0a0-438b-a255-0d1ddb1420df tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:10.693307 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-dd7aea8e-c0a0-438b-a255-0d1ddb1420df tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:10.694359 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-dd7aea8e-c0a0-438b-a255-0d1ddb1420df tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:10.695018 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-dd7aea8e-c0a0-438b-a255-0d1ddb1420df tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:10.810323 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-dd7aea8e-c0a0-438b-a255-0d1ddb1420df tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 32404 microversion: 2.20 time: 0.132364 May 27 03:44:10.820714 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 281/600] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:44:10 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 32404 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:44:11.044664 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-f5e0b817-a9d4-4a10-85d3-560f61e4ad90 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:11.045309 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-f5e0b817-a9d4-4a10-85d3-560f61e4ad90 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 6a78b67b-ae82-47f7-9c4a-3698918592c6] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:11.064372 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f5e0b817-a9d4-4a10-85d3-560f61e4ad90 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:11.065295 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f5e0b817-a9d4-4a10-85d3-560f61e4ad90 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:11.065623 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f5e0b817-a9d4-4a10-85d3-560f61e4ad90 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:11.066061 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f5e0b817-a9d4-4a10-85d3-560f61e4ad90 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:11.285689 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-c514c40e-326f-49df-8c69-b5399a0e9b7e tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:11.287779 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-c514c40e-326f-49df-8c69-b5399a0e9b7e tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:11.302973 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c514c40e-326f-49df-8c69-b5399a0e9b7e tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:11.303513 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c514c40e-326f-49df-8c69-b5399a0e9b7e tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:11.304682 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c514c40e-326f-49df-8c69-b5399a0e9b7e tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:11.305594 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c514c40e-326f-49df-8c69-b5399a0e9b7e tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:11.621248 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-f5e0b817-a9d4-4a10-85d3-560f61e4ad90 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:11.631548 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-f5e0b817-a9d4-4a10-85d3-560f61e4ad90 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/6a78b67b-ae82-47f7-9c4a-3698918592c6" status: 200 len: 1515 microversion: 2.1 time: 0.591540 May 27 03:44:11.632144 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 320/601] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:44:11 2021] GET /compute/v2.1/servers/6a78b67b-ae82-47f7-9c4a-3698918592c6 => generated 1515 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:11.645993 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-a64541f2-657c-42f3-9610-bfb2ea0a7b47 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:44:11.646971 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-a64541f2-657c-42f3-9610-bfb2ea0a7b47 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:11.660368 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a64541f2-657c-42f3-9610-bfb2ea0a7b47 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:11.660845 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a64541f2-657c-42f3-9610-bfb2ea0a7b47 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:11.661805 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a64541f2-657c-42f3-9610-bfb2ea0a7b47 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:11.662267 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a64541f2-657c-42f3-9610-bfb2ea0a7b47 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:11.769859 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-a64541f2-657c-42f3-9610-bfb2ea0a7b47 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 33201 microversion: 2.1 time: 0.127200 May 27 03:44:11.770510 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 321/602] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:44:11 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 33201 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:44:11.825008 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-7e4e451a-387f-4fd1-9fbd-e77678561cc5 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:44:11.829116 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-7e4e451a-387f-4fd1-9fbd-e77678561cc5 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:11.837882 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7e4e451a-387f-4fd1-9fbd-e77678561cc5 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:11.843033 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7e4e451a-387f-4fd1-9fbd-e77678561cc5 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:11.843033 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7e4e451a-387f-4fd1-9fbd-e77678561cc5 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:11.843033 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7e4e451a-387f-4fd1-9fbd-e77678561cc5 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:11.926778 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-c514c40e-326f-49df-8c69-b5399a0e9b7e tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:11.947414 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-7e4e451a-387f-4fd1-9fbd-e77678561cc5 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 32991 microversion: 2.20 time: 0.127148 May 27 03:44:11.949055 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-c514c40e-326f-49df-8c69-b5399a0e9b7e tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0" status: 200 len: 1523 microversion: 2.1 time: 0.668813 May 27 03:44:11.950100 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 282/603] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:44:11 2021] GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0 => generated 1523 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:44:11.950700 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 322/604] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:44:11 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 32991 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:44:12.648080 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-c6b1bb33-d75f-4744-be59-68f199ef7d8c tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:12.654298 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-c6b1bb33-d75f-4744-be59-68f199ef7d8c tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 6a78b67b-ae82-47f7-9c4a-3698918592c6] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:12.658136 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c6b1bb33-d75f-4744-be59-68f199ef7d8c tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:12.658591 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c6b1bb33-d75f-4744-be59-68f199ef7d8c tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:12.659620 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c6b1bb33-d75f-4744-be59-68f199ef7d8c tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:12.660128 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c6b1bb33-d75f-4744-be59-68f199ef7d8c tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:12.783335 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-349807c4-b1da-450b-96e0-a0e531b4b0bb tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:44:12.784420 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-349807c4-b1da-450b-96e0-a0e531b4b0bb tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:12.792924 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-349807c4-b1da-450b-96e0-a0e531b4b0bb tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:12.793750 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-349807c4-b1da-450b-96e0-a0e531b4b0bb tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:12.794695 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-349807c4-b1da-450b-96e0-a0e531b4b0bb tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:12.795138 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-349807c4-b1da-450b-96e0-a0e531b4b0bb tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:12.906573 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-349807c4-b1da-450b-96e0-a0e531b4b0bb tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 33741 microversion: 2.1 time: 0.127089 May 27 03:44:12.908206 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 323/605] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:44:12 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 33741 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:44:12.961269 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-175491ae-0e70-4f36-8e9a-dc98cf6072a5 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:44:12.963085 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-175491ae-0e70-4f36-8e9a-dc98cf6072a5 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:12.973119 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-175491ae-0e70-4f36-8e9a-dc98cf6072a5 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:12.973913 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-175491ae-0e70-4f36-8e9a-dc98cf6072a5 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:12.974884 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-175491ae-0e70-4f36-8e9a-dc98cf6072a5 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:12.975373 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-175491ae-0e70-4f36-8e9a-dc98cf6072a5 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:13.054412 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-c6b1bb33-d75f-4744-be59-68f199ef7d8c tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:13.063215 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-c6b1bb33-d75f-4744-be59-68f199ef7d8c tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/6a78b67b-ae82-47f7-9c4a-3698918592c6" status: 200 len: 1515 microversion: 2.1 time: 0.418757 May 27 03:44:13.063860 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 283/606] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:44:12 2021] GET /compute/v2.1/servers/6a78b67b-ae82-47f7-9c4a-3698918592c6 => generated 1515 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:13.068357 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-ae61a5fc-0ef6-4dc8-a26f-49cdd28e63b3 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:13.069057 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-ae61a5fc-0ef6-4dc8-a26f-49cdd28e63b3 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:13.076307 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ae61a5fc-0ef6-4dc8-a26f-49cdd28e63b3 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:13.076973 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ae61a5fc-0ef6-4dc8-a26f-49cdd28e63b3 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:13.077786 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ae61a5fc-0ef6-4dc8-a26f-49cdd28e63b3 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:13.078222 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ae61a5fc-0ef6-4dc8-a26f-49cdd28e63b3 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:13.092953 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-175491ae-0e70-4f36-8e9a-dc98cf6072a5 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 33767 microversion: 2.20 time: 0.136932 May 27 03:44:13.095402 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 324/607] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:44:12 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 33767 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:44:13.569297 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [req-8bff2091-3d5e-4a2b-91ae-7a08ceb81d7f req-ec637307-1081-4af5-954e-7844e2649a82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a78b67b-ae82-47f7-9c4a-3698918592c6", "name": "network-vif-deleted", "tag": "7c9d543c-8635-48f1-aa64-5b32d4b0b972"}]} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:44:13.570903 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:44:13.570903 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: warnings.warn(msg) May 27 03:44:13.581698 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-8bff2091-3d5e-4a2b-91ae-7a08ceb81d7f req-ec637307-1081-4af5-954e-7844e2649a82 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:13.582226 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-8bff2091-3d5e-4a2b-91ae-7a08ceb81d7f req-ec637307-1081-4af5-954e-7844e2649a82 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:13.600278 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.compute.server_external_events [req-8bff2091-3d5e-4a2b-91ae-7a08ceb81d7f req-ec637307-1081-4af5-954e-7844e2649a82 service nova] Creating event network-vif-deleted:7c9d543c-8635-48f1-aa64-5b32d4b0b972 for instance 6a78b67b-ae82-47f7-9c4a-3698918592c6 on hv-cinder-79326 May 27 03:44:13.613532 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [req-8bff2091-3d5e-4a2b-91ae-7a08ceb81d7f req-ec637307-1081-4af5-954e-7844e2649a82 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042464 May 27 03:44:13.613532 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 325/608] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:44:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:44:13.920029 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-6cf7144a-c7cd-4949-8288-62335647ebcd tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:44:13.922553 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-6cf7144a-c7cd-4949-8288-62335647ebcd tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:13.945943 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6cf7144a-c7cd-4949-8288-62335647ebcd tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:13.949347 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6cf7144a-c7cd-4949-8288-62335647ebcd tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:13.950203 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6cf7144a-c7cd-4949-8288-62335647ebcd tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:13.952791 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6cf7144a-c7cd-4949-8288-62335647ebcd tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:14.020387 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-ae61a5fc-0ef6-4dc8-a26f-49cdd28e63b3 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:14.034703 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-ae61a5fc-0ef6-4dc8-a26f-49cdd28e63b3 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0" status: 200 len: 1523 microversion: 2.1 time: 0.969553 May 27 03:44:14.035652 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 284/609] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:44:13 2021] GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0 => generated 1523 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:14.079871 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-6238798d-5ec1-4bb7-a11c-4ee89495611e tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:14.080899 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-6238798d-5ec1-4bb7-a11c-4ee89495611e tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 6a78b67b-ae82-47f7-9c4a-3698918592c6] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:14.096035 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6238798d-5ec1-4bb7-a11c-4ee89495611e tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:14.096728 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6238798d-5ec1-4bb7-a11c-4ee89495611e tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:14.097823 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6238798d-5ec1-4bb7-a11c-4ee89495611e tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:14.098349 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6238798d-5ec1-4bb7-a11c-4ee89495611e tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:14.143549 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-6cf7144a-c7cd-4949-8288-62335647ebcd tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 34778 microversion: 2.1 time: 0.227364 May 27 03:44:14.144520 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 326/610] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:44:13 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 34778 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:44:14.153251 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-b84f2c75-e15f-4347-99e1-aca90ceec2e3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:44:14.154447 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-b84f2c75-e15f-4347-99e1-aca90ceec2e3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:14.175995 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b84f2c75-e15f-4347-99e1-aca90ceec2e3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:14.176791 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b84f2c75-e15f-4347-99e1-aca90ceec2e3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:14.177761 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b84f2c75-e15f-4347-99e1-aca90ceec2e3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:14.178358 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b84f2c75-e15f-4347-99e1-aca90ceec2e3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:14.234739 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6238798d-5ec1-4bb7-a11c-4ee89495611e tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:14.235686 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6238798d-5ec1-4bb7-a11c-4ee89495611e tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:14.236586 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.objects.instance [None req-6238798d-5ec1-4bb7-a11c-4ee89495611e tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lazy-loading 'fault' on Instance uuid 6a78b67b-ae82-47f7-9c4a-3698918592c6 {{(pid=113021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 27 03:44:14.349889 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-b84f2c75-e15f-4347-99e1-aca90ceec2e3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 35074 microversion: 2.20 time: 0.203506 May 27 03:44:14.351098 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 327/611] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:44:14 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 35074 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:44:14.805904 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-6238798d-5ec1-4bb7-a11c-4ee89495611e tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:14.837561 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-6238798d-5ec1-4bb7-a11c-4ee89495611e tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/6a78b67b-ae82-47f7-9c4a-3698918592c6" status: 200 len: 1308 microversion: 2.1 time: 0.761204 May 27 03:44:14.838458 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 285/612] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:44:14 2021] GET /compute/v2.1/servers/6a78b67b-ae82-47f7-9c4a-3698918592c6 => generated 1308 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:44:15.053553 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-66fcb987-ad69-4241-b848-1bf07d935e9f tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:15.054936 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-66fcb987-ad69-4241-b848-1bf07d935e9f tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:15.072126 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-66fcb987-ad69-4241-b848-1bf07d935e9f tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:15.073667 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-66fcb987-ad69-4241-b848-1bf07d935e9f tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:15.075097 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-66fcb987-ad69-4241-b848-1bf07d935e9f tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:15.076534 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-66fcb987-ad69-4241-b848-1bf07d935e9f tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:15.157295 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-47f4d463-95eb-424d-8f82-f2ef708bb9e3 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:44:15.158316 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-47f4d463-95eb-424d-8f82-f2ef708bb9e3 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:15.177947 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-47f4d463-95eb-424d-8f82-f2ef708bb9e3 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:15.178815 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-47f4d463-95eb-424d-8f82-f2ef708bb9e3 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:15.179848 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-47f4d463-95eb-424d-8f82-f2ef708bb9e3 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:15.183087 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-47f4d463-95eb-424d-8f82-f2ef708bb9e3 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:15.386367 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-47f4d463-95eb-424d-8f82-f2ef708bb9e3 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 35861 microversion: 2.1 time: 0.232997 May 27 03:44:15.393302 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 286/613] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:44:15 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 35861 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:44:15.418920 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-a0d508e7-55b4-4145-b30c-3427beb688ef tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:44:15.423314 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-a0d508e7-55b4-4145-b30c-3427beb688ef tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:15.460018 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a0d508e7-55b4-4145-b30c-3427beb688ef tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:15.468561 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a0d508e7-55b4-4145-b30c-3427beb688ef tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:15.473172 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a0d508e7-55b4-4145-b30c-3427beb688ef tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:15.474423 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a0d508e7-55b4-4145-b30c-3427beb688ef tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:15.657708 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-66fcb987-ad69-4241-b848-1bf07d935e9f tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:15.669569 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-66fcb987-ad69-4241-b848-1bf07d935e9f tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0" status: 200 len: 1523 microversion: 2.1 time: 0.618650 May 27 03:44:15.682337 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 328/614] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:44:15 2021] GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0 => generated 1523 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:15.713439 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-a0d508e7-55b4-4145-b30c-3427beb688ef tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 36739 microversion: 2.20 time: 0.313437 May 27 03:44:15.715197 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 287/615] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:44:15 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 36739 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:44:15.855140 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-21af20f3-02aa-4bc7-80c7-a2550a6ce455 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:15.855912 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-21af20f3-02aa-4bc7-80c7-a2550a6ce455 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 6a78b67b-ae82-47f7-9c4a-3698918592c6] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:15.870071 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-21af20f3-02aa-4bc7-80c7-a2550a6ce455 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:15.872376 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-21af20f3-02aa-4bc7-80c7-a2550a6ce455 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:15.876953 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-21af20f3-02aa-4bc7-80c7-a2550a6ce455 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:15.877551 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-21af20f3-02aa-4bc7-80c7-a2550a6ce455 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:15.967994 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.wsgi [None req-21af20f3-02aa-4bc7-80c7-a2550a6ce455 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] HTTP exception thrown: Instance 6a78b67b-ae82-47f7-9c4a-3698918592c6 could not be found. May 27 03:44:15.969298 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-21af20f3-02aa-4bc7-80c7-a2550a6ce455 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Returning 404 to user: Instance 6a78b67b-ae82-47f7-9c4a-3698918592c6 could not be found. {{(pid=113020) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 27 03:44:15.970153 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-21af20f3-02aa-4bc7-80c7-a2550a6ce455 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/6a78b67b-ae82-47f7-9c4a-3698918592c6" status: 404 len: 111 microversion: 2.1 time: 0.118899 May 27 03:44:15.974467 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 329/616] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:44:15 2021] GET /compute/v2.1/servers/6a78b67b-ae82-47f7-9c4a-3698918592c6 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:44:16.402362 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-12e68c02-75e3-4fbc-9ead-f149781e4ae9 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:44:16.403483 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-12e68c02-75e3-4fbc-9ead-f149781e4ae9 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:16.422237 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-12e68c02-75e3-4fbc-9ead-f149781e4ae9 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:16.422958 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-12e68c02-75e3-4fbc-9ead-f149781e4ae9 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:16.432574 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-12e68c02-75e3-4fbc-9ead-f149781e4ae9 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:16.432574 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-12e68c02-75e3-4fbc-9ead-f149781e4ae9 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:16.568158 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-12e68c02-75e3-4fbc-9ead-f149781e4ae9 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 37304 microversion: 2.1 time: 0.168745 May 27 03:44:16.572606 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 288/617] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:44:16 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 37304 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:44:16.687200 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-04ac7a60-715e-4569-b297-10a36874b8c0 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:16.690680 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-04ac7a60-715e-4569-b297-10a36874b8c0 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:16.702401 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-04ac7a60-715e-4569-b297-10a36874b8c0 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:16.703160 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-04ac7a60-715e-4569-b297-10a36874b8c0 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:16.704095 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-04ac7a60-715e-4569-b297-10a36874b8c0 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:16.704682 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-04ac7a60-715e-4569-b297-10a36874b8c0 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:16.725988 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-778706af-41af-4f2e-a8f5-5e8eb817e208 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:44:16.727006 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-778706af-41af-4f2e-a8f5-5e8eb817e208 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:16.742324 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-778706af-41af-4f2e-a8f5-5e8eb817e208 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:16.743028 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-778706af-41af-4f2e-a8f5-5e8eb817e208 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:16.743990 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-778706af-41af-4f2e-a8f5-5e8eb817e208 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:16.744714 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-778706af-41af-4f2e-a8f5-5e8eb817e208 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:16.960101 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-778706af-41af-4f2e-a8f5-5e8eb817e208 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 38236 microversion: 2.20 time: 0.237823 May 27 03:44:16.962737 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 289/618] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:44:16 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 38236 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:44:16.980348 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [req-28d9a716-21e2-41ca-bcd6-00bfed09bb12 req-9c26c58b-ab54-4828-82e7-e3a3a4a26565 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0", "name": "network-vif-deleted", "tag": "3f12ac65-af0d-4c74-bfa1-375cddc42ae8"}]} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:44:16.982429 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:44:16.982429 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: warnings.warn(msg) May 27 03:44:16.999278 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-04ac7a60-715e-4569-b297-10a36874b8c0 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:17.005093 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-28d9a716-21e2-41ca-bcd6-00bfed09bb12 req-9c26c58b-ab54-4828-82e7-e3a3a4a26565 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:17.005544 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-28d9a716-21e2-41ca-bcd6-00bfed09bb12 req-9c26c58b-ab54-4828-82e7-e3a3a4a26565 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:17.013261 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-04ac7a60-715e-4569-b297-10a36874b8c0 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0" status: 200 len: 1481 microversion: 2.1 time: 0.329895 May 27 03:44:17.014486 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 330/619] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:44:16 2021] GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0 => generated 1481 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:17.035831 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.compute.server_external_events [req-28d9a716-21e2-41ca-bcd6-00bfed09bb12 req-9c26c58b-ab54-4828-82e7-e3a3a4a26565 service nova] Creating event network-vif-deleted:3f12ac65-af0d-4c74-bfa1-375cddc42ae8 for instance 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0 on hv-cinder-79326 May 27 03:44:17.041904 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [req-28d9a716-21e2-41ca-bcd6-00bfed09bb12 req-9c26c58b-ab54-4828-82e7-e3a3a4a26565 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077496 May 27 03:44:17.042505 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 290/620] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:44:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:44:17.484286 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-bf83c9e9-00fe-4f87-bf0e-a22faccb1aaf tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:17.485199 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-bf83c9e9-00fe-4f87-bf0e-a22faccb1aaf tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 695616b8-9b90-4e8d-b719-de3eabe09cbe] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:17.494324 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-bf83c9e9-00fe-4f87-bf0e-a22faccb1aaf tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:17.495060 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-bf83c9e9-00fe-4f87-bf0e-a22faccb1aaf tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:17.496023 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-bf83c9e9-00fe-4f87-bf0e-a22faccb1aaf tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:17.496650 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-bf83c9e9-00fe-4f87-bf0e-a22faccb1aaf tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:17.584845 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-0ffff011-cc64-4a0f-8a47-da3f1927fa27 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:44:17.587012 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-0ffff011-cc64-4a0f-8a47-da3f1927fa27 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:17.618661 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-bf83c9e9-00fe-4f87-bf0e-a22faccb1aaf tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 695616b8-9b90-4e8d-b719-de3eabe09cbe] Going to try to terminate instance {{(pid=113020) delete /opt/stack/nova/nova/compute/api.py:2539}} May 27 03:44:17.637337 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-0ffff011-cc64-4a0f-8a47-da3f1927fa27 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:17.639254 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-0ffff011-cc64-4a0f-8a47-da3f1927fa27 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:17.640379 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-0ffff011-cc64-4a0f-8a47-da3f1927fa27 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:17.643143 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-0ffff011-cc64-4a0f-8a47-da3f1927fa27 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:17.752422 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-0ffff011-cc64-4a0f-8a47-da3f1927fa27 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 38220 microversion: 2.1 time: 0.171821 May 27 03:44:17.753446 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 291/621] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:44:17 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 38220 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 03:44:17.977766 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-80ffabc8-41d1-4482-90fb-be4e38fb0ebb tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:44:17.979121 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-80ffabc8-41d1-4482-90fb-be4e38fb0ebb tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:17.993529 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-80ffabc8-41d1-4482-90fb-be4e38fb0ebb tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:17.994289 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-80ffabc8-41d1-4482-90fb-be4e38fb0ebb tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:17.997277 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-80ffabc8-41d1-4482-90fb-be4e38fb0ebb tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:17.997938 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-80ffabc8-41d1-4482-90fb-be4e38fb0ebb tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:18.163665 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-80ffabc8-41d1-4482-90fb-be4e38fb0ebb tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 38236 microversion: 2.20 time: 0.191880 May 27 03:44:18.170105 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 292/622] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:44:17 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 38236 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:44:18.184302 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-038714aa-ad05-4a22-839d-9673f8a980d6 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:18.186233 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-038714aa-ad05-4a22-839d-9673f8a980d6 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:18.223383 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-038714aa-ad05-4a22-839d-9673f8a980d6 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:18.231985 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-038714aa-ad05-4a22-839d-9673f8a980d6 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:18.233087 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-038714aa-ad05-4a22-839d-9673f8a980d6 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:18.233729 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-038714aa-ad05-4a22-839d-9673f8a980d6 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:18.330283 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-bf83c9e9-00fe-4f87-bf0e-a22faccb1aaf tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "DELETE /compute/v2.1/servers/695616b8-9b90-4e8d-b719-de3eabe09cbe" status: 204 len: 0 microversion: 2.1 time: 0.850479 May 27 03:44:18.332145 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 331/623] 10.222.0.25 () {58 vars in 1239 bytes} [Thu May 27 03:44:17 2021] DELETE /compute/v2.1/servers/695616b8-9b90-4e8d-b719-de3eabe09cbe => generated 0 bytes in 853 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 03:44:18.339394 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-038714aa-ad05-4a22-839d-9673f8a980d6 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:18.339942 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-038714aa-ad05-4a22-839d-9673f8a980d6 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:18.340673 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.objects.instance [None req-038714aa-ad05-4a22-839d-9673f8a980d6 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lazy-loading 'fault' on Instance uuid 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0 {{(pid=113021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 27 03:44:18.344375 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-2cbc945f-5b0a-405e-8c73-c0939192cef5 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:18.351621 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-2cbc945f-5b0a-405e-8c73-c0939192cef5 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 695616b8-9b90-4e8d-b719-de3eabe09cbe] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:18.384704 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-2cbc945f-5b0a-405e-8c73-c0939192cef5 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:18.386837 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-2cbc945f-5b0a-405e-8c73-c0939192cef5 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:18.401734 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-2cbc945f-5b0a-405e-8c73-c0939192cef5 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:18.405259 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-2cbc945f-5b0a-405e-8c73-c0939192cef5 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:18.732231 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-038714aa-ad05-4a22-839d-9673f8a980d6 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806656c3c07441d98bf4bf9e10c0296d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa24b9f82e13448382e6b5f6bd699fab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:18.749197 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-038714aa-ad05-4a22-839d-9673f8a980d6 tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0" status: 200 len: 1312 microversion: 2.1 time: 0.577281 May 27 03:44:18.756456 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 293/624] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:44:18 2021] GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0 => generated 1312 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:18.772992 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-2cbc945f-5b0a-405e-8c73-c0939192cef5 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:18.782403 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-2cbc945f-5b0a-405e-8c73-c0939192cef5 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/695616b8-9b90-4e8d-b719-de3eabe09cbe" status: 200 len: 1514 microversion: 2.1 time: 0.446220 May 27 03:44:18.783543 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 332/625] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:44:18 2021] GET /compute/v2.1/servers/695616b8-9b90-4e8d-b719-de3eabe09cbe => generated 1514 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:18.793410 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-d662f292-e556-4782-974d-626d510449aa tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:44:18.795033 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-d662f292-e556-4782-974d-626d510449aa tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:18.802476 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d662f292-e556-4782-974d-626d510449aa tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:18.803304 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d662f292-e556-4782-974d-626d510449aa tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:18.804271 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d662f292-e556-4782-974d-626d510449aa tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:18.804762 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d662f292-e556-4782-974d-626d510449aa tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:18.921102 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-d662f292-e556-4782-974d-626d510449aa tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 38220 microversion: 2.1 time: 0.152699 May 27 03:44:18.921971 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 294/626] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:44:18 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 38220 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:44:19.144470 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [req-1c1392e2-f689-499b-953c-17a840a90fde req-9cb6c0cd-d280-470a-95c5-2b1e0d160210 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02984890-fe33-4d25-bf6d-a3c3163a965f", "tag": "2554297d-a794-4bc9-9cb3-56dce4e9fb2f"}]} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:44:19.150613 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:44:19.150613 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: warnings.warn(msg) May 27 03:44:19.164063 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-1c1392e2-f689-499b-953c-17a840a90fde req-9cb6c0cd-d280-470a-95c5-2b1e0d160210 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:19.164801 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-1c1392e2-f689-499b-953c-17a840a90fde req-9cb6c0cd-d280-470a-95c5-2b1e0d160210 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:19.178807 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-f8295ea4-3825-4113-8b39-1227d5c53f14 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:44:19.179821 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-f8295ea4-3825-4113-8b39-1227d5c53f14 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:19.193761 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f8295ea4-3825-4113-8b39-1227d5c53f14 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:19.193982 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f8295ea4-3825-4113-8b39-1227d5c53f14 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:19.194767 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f8295ea4-3825-4113-8b39-1227d5c53f14 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:19.195212 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f8295ea4-3825-4113-8b39-1227d5c53f14 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:19.212796 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.compute.server_external_events [req-1c1392e2-f689-499b-953c-17a840a90fde req-9cb6c0cd-d280-470a-95c5-2b1e0d160210 service nova] Creating event network-changed:2554297d-a794-4bc9-9cb3-56dce4e9fb2f for instance 02984890-fe33-4d25-bf6d-a3c3163a965f on hv-cinder-79326 May 27 03:44:19.225189 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [req-1c1392e2-f689-499b-953c-17a840a90fde req-9cb6c0cd-d280-470a-95c5-2b1e0d160210 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084793 May 27 03:44:19.226096 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 333/627] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:44:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:44:19.367215 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-f8295ea4-3825-4113-8b39-1227d5c53f14 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 38236 microversion: 2.20 time: 0.190924 May 27 03:44:19.367894 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 295/628] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:44:19 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 38236 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:44:19.767418 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-0b69f962-5eec-40aa-acd3-fbd355fcbe8b tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:19.771313 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-0b69f962-5eec-40aa-acd3-fbd355fcbe8b tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] [instance: 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:19.786553 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0b69f962-5eec-40aa-acd3-fbd355fcbe8b tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:19.787011 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0b69f962-5eec-40aa-acd3-fbd355fcbe8b tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:19.790721 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0b69f962-5eec-40aa-acd3-fbd355fcbe8b tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:19.791385 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0b69f962-5eec-40aa-acd3-fbd355fcbe8b tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:19.802267 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-12397990-b7fb-49ff-8096-adea98d1adac tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:19.803289 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-12397990-b7fb-49ff-8096-adea98d1adac tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 695616b8-9b90-4e8d-b719-de3eabe09cbe] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:19.817360 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-12397990-b7fb-49ff-8096-adea98d1adac tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:19.820026 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-12397990-b7fb-49ff-8096-adea98d1adac tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:19.820987 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-12397990-b7fb-49ff-8096-adea98d1adac tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:19.821914 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-12397990-b7fb-49ff-8096-adea98d1adac tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:19.876255 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.wsgi [None req-0b69f962-5eec-40aa-acd3-fbd355fcbe8b tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] HTTP exception thrown: Instance 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0 could not be found. May 27 03:44:19.876979 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-0b69f962-5eec-40aa-acd3-fbd355fcbe8b tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] Returning 404 to user: Instance 1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0 could not be found. {{(pid=113020) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 27 03:44:19.877902 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-0b69f962-5eec-40aa-acd3-fbd355fcbe8b tempest-ServerRescueNegativeTestJSON-1319136368 tempest-ServerRescueNegativeTestJSON-1319136368-project] 10.222.0.25 "GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0" status: 404 len: 111 microversion: 2.1 time: 0.114926 May 27 03:44:19.878898 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 334/629] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:44:19 2021] GET /compute/v2.1/servers/1a0adeb2-9abe-4dfa-8fd5-1aa17e3b69e0 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:44:19.934163 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-15df145d-b5af-4970-93f3-e1c8309acf08 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:44:19.935277 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-15df145d-b5af-4970-93f3-e1c8309acf08 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:19.943610 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-15df145d-b5af-4970-93f3-e1c8309acf08 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:19.948735 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-15df145d-b5af-4970-93f3-e1c8309acf08 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:19.948735 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-15df145d-b5af-4970-93f3-e1c8309acf08 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:19.948735 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-15df145d-b5af-4970-93f3-e1c8309acf08 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:20.066413 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-15df145d-b5af-4970-93f3-e1c8309acf08 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 38220 microversion: 2.1 time: 0.135985 May 27 03:44:20.067853 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 335/630] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:44:19 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 38220 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 03:44:20.272886 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-12397990-b7fb-49ff-8096-adea98d1adac tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:20.283221 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-12397990-b7fb-49ff-8096-adea98d1adac tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/695616b8-9b90-4e8d-b719-de3eabe09cbe" status: 200 len: 1514 microversion: 2.1 time: 0.486834 May 27 03:44:20.294068 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 296/631] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:44:19 2021] GET /compute/v2.1/servers/695616b8-9b90-4e8d-b719-de3eabe09cbe => generated 1514 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:20.380379 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-fb9b0174-58b1-4462-868d-b5f3021d78dd tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:44:20.385248 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-fb9b0174-58b1-4462-868d-b5f3021d78dd tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:20.398639 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-fb9b0174-58b1-4462-868d-b5f3021d78dd tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:20.401500 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-fb9b0174-58b1-4462-868d-b5f3021d78dd tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:20.406161 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-fb9b0174-58b1-4462-868d-b5f3021d78dd tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:20.406752 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-fb9b0174-58b1-4462-868d-b5f3021d78dd tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:20.528498 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-fb9b0174-58b1-4462-868d-b5f3021d78dd tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 38236 microversion: 2.20 time: 0.152180 May 27 03:44:20.529699 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 336/632] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:44:20 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 38236 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:44:21.081041 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-5751d1cc-2ccd-4d5e-9ad2-262049f6eae9 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:44:21.082989 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-5751d1cc-2ccd-4d5e-9ad2-262049f6eae9 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:21.090612 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-5751d1cc-2ccd-4d5e-9ad2-262049f6eae9 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:21.091421 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-5751d1cc-2ccd-4d5e-9ad2-262049f6eae9 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:21.092380 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-5751d1cc-2ccd-4d5e-9ad2-262049f6eae9 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:21.093553 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-5751d1cc-2ccd-4d5e-9ad2-262049f6eae9 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:21.267724 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-5751d1cc-2ccd-4d5e-9ad2-262049f6eae9 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 200 len: 38351 microversion: 2.1 time: 0.192411 May 27 03:44:21.273244 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 297/633] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:44:21 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 38351 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:44:21.278739 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-626231c7-0c7e-40a2-bfd0-4ee17349a5b3 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:21.279310 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-626231c7-0c7e-40a2-bfd0-4ee17349a5b3 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:21.294195 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-626231c7-0c7e-40a2-bfd0-4ee17349a5b3 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:21.294954 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-626231c7-0c7e-40a2-bfd0-4ee17349a5b3 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:21.301687 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-d4d7234c-3d8a-4db6-b26a-1b1b7f6491d4 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:21.301891 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-626231c7-0c7e-40a2-bfd0-4ee17349a5b3 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:21.302720 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-d4d7234c-3d8a-4db6-b26a-1b1b7f6491d4 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 695616b8-9b90-4e8d-b719-de3eabe09cbe] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:21.304465 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-626231c7-0c7e-40a2-bfd0-4ee17349a5b3 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:21.317646 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d4d7234c-3d8a-4db6-b26a-1b1b7f6491d4 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:21.318189 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d4d7234c-3d8a-4db6-b26a-1b1b7f6491d4 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:21.319086 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d4d7234c-3d8a-4db6-b26a-1b1b7f6491d4 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:21.320725 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d4d7234c-3d8a-4db6-b26a-1b1b7f6491d4 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:21.382300 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-626231c7-0c7e-40a2-bfd0-4ee17349a5b3 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/ips" status: 200 len: 145 microversion: 2.1 time: 0.107453 May 27 03:44:21.388292 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 337/634] 10.222.0.25 () {58 vars in 1248 bytes} [Thu May 27 03:44:21 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/ips => generated 145 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:44:21.541003 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-031b96d0-84ce-409c-a15d-8dab904d22a8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:44:21.542359 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-031b96d0-84ce-409c-a15d-8dab904d22a8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:21.558051 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-031b96d0-84ce-409c-a15d-8dab904d22a8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:21.558051 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-031b96d0-84ce-409c-a15d-8dab904d22a8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:21.558051 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-031b96d0-84ce-409c-a15d-8dab904d22a8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:21.558051 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-031b96d0-84ce-409c-a15d-8dab904d22a8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:21.669709 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-031b96d0-84ce-409c-a15d-8dab904d22a8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 200 len: 38379 microversion: 2.20 time: 0.132519 May 27 03:44:21.670598 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 338/635] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:44:21 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 38379 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 27 03:44:21.683083 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-d4d7234c-3d8a-4db6-b26a-1b1b7f6491d4 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:21.687336 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [req-492720cb-6e4c-42ab-b7e6-0bba12177804 req-c5df673d-07a7-40b7-b74f-00cdcb6531a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "695616b8-9b90-4e8d-b719-de3eabe09cbe", "name": "network-vif-deleted", "tag": "1279817e-ea8d-4755-966e-3691e51297b7"}]} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:44:21.688235 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:44:21.688235 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: warnings.warn(msg) May 27 03:44:21.697101 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-d4d7234c-3d8a-4db6-b26a-1b1b7f6491d4 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/695616b8-9b90-4e8d-b719-de3eabe09cbe" status: 200 len: 1472 microversion: 2.1 time: 0.399308 May 27 03:44:21.697877 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 298/636] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:44:21 2021] GET /compute/v2.1/servers/695616b8-9b90-4e8d-b719-de3eabe09cbe => generated 1472 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:21.698741 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-492720cb-6e4c-42ab-b7e6-0bba12177804 req-c5df673d-07a7-40b7-b74f-00cdcb6531a3 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:21.699285 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-492720cb-6e4c-42ab-b7e6-0bba12177804 req-c5df673d-07a7-40b7-b74f-00cdcb6531a3 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:21.702269 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-6b49e62e-8f89-4acb-8281-65c82894068e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:21.708852 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-6b49e62e-8f89-4acb-8281-65c82894068e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:21.720003 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6b49e62e-8f89-4acb-8281-65c82894068e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:21.720797 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.compute.server_external_events [req-492720cb-6e4c-42ab-b7e6-0bba12177804 req-c5df673d-07a7-40b7-b74f-00cdcb6531a3 service nova] Creating event network-vif-deleted:1279817e-ea8d-4755-966e-3691e51297b7 for instance 695616b8-9b90-4e8d-b719-de3eabe09cbe on hv-cinder-79326 May 27 03:44:21.721232 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6b49e62e-8f89-4acb-8281-65c82894068e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:21.722194 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6b49e62e-8f89-4acb-8281-65c82894068e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:21.722951 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6b49e62e-8f89-4acb-8281-65c82894068e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:21.726400 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [req-492720cb-6e4c-42ab-b7e6-0bba12177804 req-c5df673d-07a7-40b7-b74f-00cdcb6531a3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053757 May 27 03:44:21.729353 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 339/637] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:44:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:44:21.785273 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-6b49e62e-8f89-4acb-8281-65c82894068e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/ips" status: 200 len: 152 microversion: 2.20 time: 0.086409 May 27 03:44:21.786138 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 299/638] 10.222.0.25 () {60 vars in 1289 bytes} [Thu May 27 03:44:21 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/ips => generated 152 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:44:22.714957 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-477a8961-d536-4a61-b8de-2933e24a946e tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:22.716388 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-477a8961-d536-4a61-b8de-2933e24a946e tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 695616b8-9b90-4e8d-b719-de3eabe09cbe] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:22.723093 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-477a8961-d536-4a61-b8de-2933e24a946e tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:22.723554 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-477a8961-d536-4a61-b8de-2933e24a946e tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:22.724317 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-477a8961-d536-4a61-b8de-2933e24a946e tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:22.724774 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-477a8961-d536-4a61-b8de-2933e24a946e tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:22.803386 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-477a8961-d536-4a61-b8de-2933e24a946e tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:22.804281 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-477a8961-d536-4a61-b8de-2933e24a946e tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:22.804281 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.objects.instance [None req-477a8961-d536-4a61-b8de-2933e24a946e tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lazy-loading 'fault' on Instance uuid 695616b8-9b90-4e8d-b719-de3eabe09cbe {{(pid=113020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 27 03:44:22.922525 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-477a8961-d536-4a61-b8de-2933e24a946e tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925b5b18987f4e1eac67fda030a1714a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7413f58ffa8e476fb5600cbc51ee9d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:22.930551 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-477a8961-d536-4a61-b8de-2933e24a946e tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/695616b8-9b90-4e8d-b719-de3eabe09cbe" status: 200 len: 1308 microversion: 2.1 time: 0.220103 May 27 03:44:22.931937 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 340/639] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:44:22 2021] GET /compute/v2.1/servers/695616b8-9b90-4e8d-b719-de3eabe09cbe => generated 1308 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:23.950334 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-5aa20fef-f549-48cf-9443-3c909557c427 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:23.950334 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-5aa20fef-f549-48cf-9443-3c909557c427 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] [instance: 695616b8-9b90-4e8d-b719-de3eabe09cbe] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:23.957978 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-5aa20fef-f549-48cf-9443-3c909557c427 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:23.958715 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-5aa20fef-f549-48cf-9443-3c909557c427 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:23.959771 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-5aa20fef-f549-48cf-9443-3c909557c427 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:23.960374 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-5aa20fef-f549-48cf-9443-3c909557c427 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:24.014216 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.wsgi [None req-5aa20fef-f549-48cf-9443-3c909557c427 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] HTTP exception thrown: Instance 695616b8-9b90-4e8d-b719-de3eabe09cbe could not be found. May 27 03:44:24.015157 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-5aa20fef-f549-48cf-9443-3c909557c427 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] Returning 404 to user: Instance 695616b8-9b90-4e8d-b719-de3eabe09cbe could not be found. {{(pid=113021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 27 03:44:24.016159 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-5aa20fef-f549-48cf-9443-3c909557c427 tempest-AttachVolumeNegativeTest-1932261218 tempest-AttachVolumeNegativeTest-1932261218-project] 10.222.0.25 "GET /compute/v2.1/servers/695616b8-9b90-4e8d-b719-de3eabe09cbe" status: 404 len: 111 microversion: 2.1 time: 0.071397 May 27 03:44:24.017230 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 300/640] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:44:23 2021] GET /compute/v2.1/servers/695616b8-9b90-4e8d-b719-de3eabe09cbe => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:44:25.458243 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-39caff3c-8c79-4560-9be4-4d1ec43909fe tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:44:25.459560 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-39caff3c-8c79-4560-9be4-4d1ec43909fe tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:25.477801 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-39caff3c-8c79-4560-9be4-4d1ec43909fe tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:25.478251 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-39caff3c-8c79-4560-9be4-4d1ec43909fe tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:25.489910 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-39caff3c-8c79-4560-9be4-4d1ec43909fe tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:25.490664 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-39caff3c-8c79-4560-9be4-4d1ec43909fe tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:25.617742 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.objects.instance [None req-39caff3c-8c79-4560-9be4-4d1ec43909fe tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lazy-loading 'flavor' on Instance uuid e367eb4b-29c5-4f41-b41d-0da84d751fe2 {{(pid=113020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 27 03:44:25.969313 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-bda7cc81-6b68-4ef9-98f4-5e36aec82090 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b9add35f-03ae-4e56-a5ab-5c4940e04ba8"}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:44:25.971157 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-bda7cc81-6b68-4ef9-98f4-5e36aec82090 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:25.979896 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-bda7cc81-6b68-4ef9-98f4-5e36aec82090 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:25.980377 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-bda7cc81-6b68-4ef9-98f4-5e36aec82090 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:25.981181 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-bda7cc81-6b68-4ef9-98f4-5e36aec82090 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:25.981628 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-bda7cc81-6b68-4ef9-98f4-5e36aec82090 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:26.624877 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-39caff3c-8c79-4560-9be4-4d1ec43909fe tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 202 len: 0 microversion: 2.20 time: 1.165125 May 27 03:44:26.628844 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 341/641] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:44:25 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 0 bytes in 1175 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 27 03:44:26.634806 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-2393c7aa-155a-425f-b3b4-7604113ad52a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:26.635621 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-2393c7aa-155a-425f-b3b4-7604113ad52a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:26.654180 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-2393c7aa-155a-425f-b3b4-7604113ad52a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:26.654727 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-2393c7aa-155a-425f-b3b4-7604113ad52a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:26.664611 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-2393c7aa-155a-425f-b3b4-7604113ad52a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:26.664611 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-2393c7aa-155a-425f-b3b4-7604113ad52a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:27.046669 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-2393c7aa-155a-425f-b3b4-7604113ad52a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:27.056286 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-2393c7aa-155a-425f-b3b4-7604113ad52a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:27.057861 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-2393c7aa-155a-425f-b3b4-7604113ad52a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:27.059012 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-2393c7aa-155a-425f-b3b4-7604113ad52a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1723 microversion: 2.20 time: 0.428742 May 27 03:44:27.059573 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 342/642] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:44:26 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1723 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:44:27.500093 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-bda7cc81-6b68-4ef9-98f4-5e36aec82090 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.539844 May 27 03:44:27.501772 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 301/643] 10.222.0.25 () {60 vars in 1323 bytes} [Thu May 27 03:44:25 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/os-volume_attachments => generated 194 bytes in 1542 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:44:28.076938 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-a71bd041-a169-402b-94d3-d228f692504e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:28.078214 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-a71bd041-a169-402b-94d3-d228f692504e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:28.085413 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a71bd041-a169-402b-94d3-d228f692504e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:28.085861 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a71bd041-a169-402b-94d3-d228f692504e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:28.086619 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a71bd041-a169-402b-94d3-d228f692504e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:28.087052 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a71bd041-a169-402b-94d3-d228f692504e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:28.294809 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-a71bd041-a169-402b-94d3-d228f692504e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:28.304237 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-a71bd041-a169-402b-94d3-d228f692504e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:28.305867 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-a71bd041-a169-402b-94d3-d228f692504e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:28.306976 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-a71bd041-a169-402b-94d3-d228f692504e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1723 microversion: 2.20 time: 0.233862 May 27 03:44:28.307522 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 343/644] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:44:28 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1723 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:44:28.387021 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-3d498fde-702d-4153-befc-ccff9317b6d2 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Action: 'create', calling method: .version_select at 0x7f98892ea670>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-828566615"}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:44:28.417876 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.quota [None req-3d498fde-702d-4153-befc-ccff9317b6d2 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Getting quotas for project 0df96baa86bb4c51b3b8bece28e3e23a. Resources: {'key_pairs'} {{(pid=113021) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 27 03:44:28.422268 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.quota [None req-3d498fde-702d-4153-befc-ccff9317b6d2 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Getting quotas for user adf67cc7398a4e1cb6f565ebe2241e57 and project 0df96baa86bb4c51b3b8bece28e3e23a. Resources: {'key_pairs'} {{(pid=113021) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 27 03:44:28.433919 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3d498fde-702d-4153-befc-ccff9317b6d2 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] [99c49e49-84e2-41a1-b9c1-c3b329c816dc] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 27 03:44:28.840140 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-01afb07a-eff2-4a97-89f2-c9044ebc2b26 tempest-VolumesSnapshotsTestJSON-2002177494 tempest-VolumesSnapshotsTestJSON-2002177494-project] Action: 'create', calling method: .version_select at 0x7f987beb4160>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1355288526"}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:44:29.453362 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO oslo.messaging._drivers.impl_rabbit [None req-3d498fde-702d-4153-befc-ccff9317b6d2 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] [99c49e49-84e2-41a1-b9c1-c3b329c816dc] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 36952. May 27 03:44:29.580838 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-01afb07a-eff2-4a97-89f2-c9044ebc2b26 tempest-VolumesSnapshotsTestJSON-2002177494 tempest-VolumesSnapshotsTestJSON-2002177494-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.889129 May 27 03:44:29.581613 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 344/645] 10.222.0.25 () {60 vars in 1155 bytes} [Thu May 27 03:44:28 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 891 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) May 27 03:44:29.592207 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-8488bb07-0871-4cac-909b-652754e78268 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:29.595836 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-8488bb07-0871-4cac-909b-652754e78268 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:29.604025 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8488bb07-0871-4cac-909b-652754e78268 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:29.604506 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8488bb07-0871-4cac-909b-652754e78268 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:29.605411 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8488bb07-0871-4cac-909b-652754e78268 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:29.606025 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8488bb07-0871-4cac-909b-652754e78268 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:29.802456 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.quota [None req-3d498fde-702d-4153-befc-ccff9317b6d2 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Getting quotas for project 0df96baa86bb4c51b3b8bece28e3e23a. Resources: {'key_pairs'} {{(pid=113021) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 27 03:44:29.806917 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.quota [None req-3d498fde-702d-4153-befc-ccff9317b6d2 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Getting quotas for user adf67cc7398a4e1cb6f565ebe2241e57 and project 0df96baa86bb4c51b3b8bece28e3e23a. Resources: {'key_pairs'} {{(pid=113021) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 27 03:44:29.830540 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-3d498fde-702d-4153-befc-ccff9317b6d2 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 1.451457 May 27 03:44:29.831662 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 302/646] 10.222.0.25 () {60 vars in 1158 bytes} [Thu May 27 03:44:28 2021] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 1454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:44:29.836735 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-72fe7d7a-3586-488f-bc19-dc9209d64b5b tempest-VolumesSnapshotsTestJSON-2002177494 tempest-VolumesSnapshotsTestJSON-2002177494-project] Calling method '.version_select at 0x7f9889c13940>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:29.926762 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-8488bb07-0871-4cac-909b-652754e78268 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:29.938936 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-8488bb07-0871-4cac-909b-652754e78268 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:29.941132 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-8488bb07-0871-4cac-909b-652754e78268 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:29.942288 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-8488bb07-0871-4cac-909b-652754e78268 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1723 microversion: 2.20 time: 0.353626 May 27 03:44:29.943081 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 345/647] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:44:29 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1723 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:44:29.943468 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-72fe7d7a-3586-488f-bc19-dc9209d64b5b tempest-VolumesSnapshotsTestJSON-2002177494 tempest-VolumesSnapshotsTestJSON-2002177494-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/a0566a01-d08e-4cce-ad28-11cfb8c1795d" status: 200 len: 345 microversion: 2.1 time: 0.110363 May 27 03:44:29.944091 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 303/648] 10.222.0.25 () {58 vars in 1245 bytes} [Thu May 27 03:44:29 2021] GET /compute/v2.1/os-volumes/a0566a01-d08e-4cce-ad28-11cfb8c1795d => generated 345 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:44:29.978445 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-a95cd809-0fd1-4bca-9286-1fa9a5542736 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-372764249", "imageRef": "26d11d81-31dc-46a4-9c4f-48e8a572af6f", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-828566615", "networks": [{"uuid": "42a1ce98-c4d1-4e0b-b376-f6f97fb7e6e1"}]}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:44:30.043166 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.network.neutron [None req-a95cd809-0fd1-4bca-9286-1fa9a5542736 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] validate_networks() for [('42a1ce98-c4d1-4e0b-b376-f6f97fb7e6e1', None, None, None)] {{(pid=113020) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 27 03:44:30.642887 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.virt.hardware [None req-a95cd809-0fd1-4bca-9286-1fa9a5542736 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Flavor limits 0:0:0 {{(pid=113020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 27 03:44:30.643443 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.virt.hardware [None req-a95cd809-0fd1-4bca-9286-1fa9a5542736 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Image limits 0:0:0 {{(pid=113020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 27 03:44:30.643781 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.virt.hardware [None req-a95cd809-0fd1-4bca-9286-1fa9a5542736 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Flavor pref 0:0:0 {{(pid=113020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 27 03:44:30.644222 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.virt.hardware [None req-a95cd809-0fd1-4bca-9286-1fa9a5542736 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Image pref 0:0:0 {{(pid=113020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 27 03:44:30.644666 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.virt.hardware [None req-a95cd809-0fd1-4bca-9286-1fa9a5542736 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=113020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 27 03:44:30.653503 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a95cd809-0fd1-4bca-9286-1fa9a5542736 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:30.654031 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a95cd809-0fd1-4bca-9286-1fa9a5542736 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:30.654928 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a95cd809-0fd1-4bca-9286-1fa9a5542736 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:30.655976 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a95cd809-0fd1-4bca-9286-1fa9a5542736 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:30.673329 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.quota [None req-a95cd809-0fd1-4bca-9286-1fa9a5542736 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Getting quotas for project 0df96baa86bb4c51b3b8bece28e3e23a. Resources: {'instances', 'cores', 'ram'} {{(pid=113020) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 27 03:44:30.677474 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.quota [None req-a95cd809-0fd1-4bca-9286-1fa9a5542736 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Getting quotas for user adf67cc7398a4e1cb6f565ebe2241e57 and project 0df96baa86bb4c51b3b8bece28e3e23a. Resources: {'instances', 'cores', 'ram'} {{(pid=113020) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 27 03:44:30.688214 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-a95cd809-0fd1-4bca-9286-1fa9a5542736 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Going to run 1 instances... {{(pid=113020) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 27 03:44:30.690496 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-a95cd809-0fd1-4bca-9286-1fa9a5542736 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] [instance: daffe717-7636-45e8-813d-8b2a6075c61e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='26d11d81-31dc-46a4-9c4f-48e8a572af6f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=113020) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 27 03:44:30.805109 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-a95cd809-0fd1-4bca-9286-1fa9a5542736 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.830525 May 27 03:44:30.810519 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 346/649] 10.222.0.25 () {60 vars in 1147 bytes} [Thu May 27 03:44:29 2021] POST /compute/v2.1/servers => generated 380 bytes in 836 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 03:44:30.817114 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-63a9ad1f-787c-48b3-a677-8d37808312b3 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:30.818409 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-63a9ad1f-787c-48b3-a677-8d37808312b3 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] [instance: daffe717-7636-45e8-813d-8b2a6075c61e] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:30.962469 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-f979645e-96f7-48c2-8b99-58e83bd33aee tempest-VolumesSnapshotsTestJSON-2002177494 tempest-VolumesSnapshotsTestJSON-2002177494-project] Calling method '.version_select at 0x7f98889f7ee0>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:31.001734 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-63a9ad1f-787c-48b3-a677-8d37808312b3 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf67cc7398a4e1cb6f565ebe2241e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df96baa86bb4c51b3b8bece28e3e23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:31.011036 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-63a9ad1f-787c-48b3-a677-8d37808312b3 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] 10.222.0.25 "GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e" status: 200 len: 1257 microversion: 2.1 time: 0.199506 May 27 03:44:31.011905 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 304/650] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:44:30 2021] GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e => generated 1257 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:31.017099 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-c65287c2-8c52-4019-a265-8a38257675b8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:31.017887 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-c65287c2-8c52-4019-a265-8a38257675b8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:31.025268 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c65287c2-8c52-4019-a265-8a38257675b8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:31.025932 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c65287c2-8c52-4019-a265-8a38257675b8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:31.026717 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c65287c2-8c52-4019-a265-8a38257675b8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:31.027155 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c65287c2-8c52-4019-a265-8a38257675b8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:31.068654 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-f979645e-96f7-48c2-8b99-58e83bd33aee tempest-VolumesSnapshotsTestJSON-2002177494 tempest-VolumesSnapshotsTestJSON-2002177494-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/a0566a01-d08e-4cce-ad28-11cfb8c1795d" status: 200 len: 346 microversion: 2.1 time: 0.109818 May 27 03:44:31.069229 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 347/651] 10.222.0.25 () {58 vars in 1245 bytes} [Thu May 27 03:44:30 2021] GET /compute/v2.1/os-volumes/a0566a01-d08e-4cce-ad28-11cfb8c1795d => generated 346 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:44:31.080132 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-9538a3d0-5abc-45d9-8fcc-0805344a86cd tempest-VolumesSnapshotsTestJSON-2002177494 tempest-VolumesSnapshotsTestJSON-2002177494-project] Action: 'create', calling method: .version_select at 0x7f9888138a60>, body: {"snapshot": {"volume_id": "a0566a01-d08e-4cce-ad28-11cfb8c1795d", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1018824035"}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:44:31.224325 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-c65287c2-8c52-4019-a265-8a38257675b8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:31.233843 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-c65287c2-8c52-4019-a265-8a38257675b8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:31.235449 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-c65287c2-8c52-4019-a265-8a38257675b8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:31.236689 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-c65287c2-8c52-4019-a265-8a38257675b8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1723 microversion: 2.20 time: 0.223641 May 27 03:44:31.237307 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 305/652] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:44:31 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:44:31.614830 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-9538a3d0-5abc-45d9-8fcc-0805344a86cd tempest-VolumesSnapshotsTestJSON-2002177494 tempest-VolumesSnapshotsTestJSON-2002177494-project] 10.222.0.25 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.538518 May 27 03:44:31.615407 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 348/653] 10.222.0.25 () {60 vars in 1162 bytes} [Thu May 27 03:44:31 2021] POST /compute/v2.1/os-snapshots => generated 287 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:44:31.625606 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-8cd58c7f-5fb6-440c-a98d-c72bccdfaa85 tempest-VolumesSnapshotsTestJSON-2002177494 tempest-VolumesSnapshotsTestJSON-2002177494-project] Calling method '.version_select at 0x7f9888115430>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:31.671688 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-8cd58c7f-5fb6-440c-a98d-c72bccdfaa85 tempest-VolumesSnapshotsTestJSON-2002177494 tempest-VolumesSnapshotsTestJSON-2002177494-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/6054c673-f4c6-4da2-bbd8-57ad1a6e4536" status: 200 len: 287 microversion: 2.1 time: 0.049483 May 27 03:44:31.672251 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 306/654] 10.222.0.25 () {58 vars in 1251 bytes} [Thu May 27 03:44:31 2021] GET /compute/v2.1/os-snapshots/6054c673-f4c6-4da2-bbd8-57ad1a6e4536 => generated 287 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:44:31.681565 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-ba74ee14-f05d-4565-a20d-40c0aef3348f tempest-VolumesSnapshotsTestJSON-2002177494 tempest-VolumesSnapshotsTestJSON-2002177494-project] Calling method '.version_select at 0x7f988929ba60>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:31.719695 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-ba74ee14-f05d-4565-a20d-40c0aef3348f tempest-VolumesSnapshotsTestJSON-2002177494 tempest-VolumesSnapshotsTestJSON-2002177494-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.041763 May 27 03:44:31.720252 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 349/655] 10.222.0.25 () {58 vars in 1140 bytes} [Thu May 27 03:44:31 2021] GET /compute/v2.1/os-snapshots => generated 290 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:44:31.729875 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-145483e0-1552-4ddb-b1ad-0c8945bf83d4 tempest-VolumesSnapshotsTestJSON-2002177494 tempest-VolumesSnapshotsTestJSON-2002177494-project] Calling method '.version_select at 0x7f98881158b0>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:31.773265 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-145483e0-1552-4ddb-b1ad-0c8945bf83d4 tempest-VolumesSnapshotsTestJSON-2002177494 tempest-VolumesSnapshotsTestJSON-2002177494-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/6054c673-f4c6-4da2-bbd8-57ad1a6e4536" status: 200 len: 287 microversion: 2.1 time: 0.046889 May 27 03:44:31.773828 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 307/656] 10.222.0.25 () {58 vars in 1251 bytes} [Thu May 27 03:44:31 2021] GET /compute/v2.1/os-snapshots/6054c673-f4c6-4da2-bbd8-57ad1a6e4536 => generated 287 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:44:32.029368 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-49d72142-66b2-4f6f-bcb1-708cd20a9bba tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:32.030066 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-49d72142-66b2-4f6f-bcb1-708cd20a9bba tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] [instance: daffe717-7636-45e8-813d-8b2a6075c61e] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:32.102931 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-49d72142-66b2-4f6f-bcb1-708cd20a9bba tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf67cc7398a4e1cb6f565ebe2241e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df96baa86bb4c51b3b8bece28e3e23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:32.110825 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-49d72142-66b2-4f6f-bcb1-708cd20a9bba tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] 10.222.0.25 "GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e" status: 200 len: 1257 microversion: 2.1 time: 0.085292 May 27 03:44:32.111369 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 350/657] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:44:32 2021] GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e => generated 1257 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:32.254783 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-3ff515ac-4181-4f78-81b5-3ddd7a1f533d tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:32.255386 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-3ff515ac-4181-4f78-81b5-3ddd7a1f533d tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:32.263084 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-3ff515ac-4181-4f78-81b5-3ddd7a1f533d tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:32.263557 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-3ff515ac-4181-4f78-81b5-3ddd7a1f533d tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:32.264307 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-3ff515ac-4181-4f78-81b5-3ddd7a1f533d tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:32.265454 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-3ff515ac-4181-4f78-81b5-3ddd7a1f533d tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:32.465400 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-3ff515ac-4181-4f78-81b5-3ddd7a1f533d tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:32.474050 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-3ff515ac-4181-4f78-81b5-3ddd7a1f533d tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:32.475562 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-3ff515ac-4181-4f78-81b5-3ddd7a1f533d tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:32.479294 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-3ff515ac-4181-4f78-81b5-3ddd7a1f533d tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1723 microversion: 2.20 time: 0.225648 May 27 03:44:32.479294 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 308/658] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:44:32 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1723 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:44:32.784513 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-9068d08c-d2a9-4b33-a2c6-eb461498dfa9 tempest-VolumesSnapshotsTestJSON-2002177494 tempest-VolumesSnapshotsTestJSON-2002177494-project] Calling method '.version_select at 0x7f98881388b0>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:32.830744 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-9068d08c-d2a9-4b33-a2c6-eb461498dfa9 tempest-VolumesSnapshotsTestJSON-2002177494 tempest-VolumesSnapshotsTestJSON-2002177494-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/6054c673-f4c6-4da2-bbd8-57ad1a6e4536" status: 200 len: 287 microversion: 2.1 time: 0.049793 May 27 03:44:32.831298 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 351/659] 10.222.0.25 () {58 vars in 1251 bytes} [Thu May 27 03:44:32 2021] GET /compute/v2.1/os-snapshots/6054c673-f4c6-4da2-bbd8-57ad1a6e4536 => generated 287 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:44:33.127077 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-6ccd26d0-9297-4bb3-b903-0d91b79c64e8 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:33.127696 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-6ccd26d0-9297-4bb3-b903-0d91b79c64e8 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] [instance: daffe717-7636-45e8-813d-8b2a6075c61e] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:33.134978 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6ccd26d0-9297-4bb3-b903-0d91b79c64e8 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:33.135422 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6ccd26d0-9297-4bb3-b903-0d91b79c64e8 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:33.136237 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6ccd26d0-9297-4bb3-b903-0d91b79c64e8 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:33.136690 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6ccd26d0-9297-4bb3-b903-0d91b79c64e8 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:33.244761 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-6ccd26d0-9297-4bb3-b903-0d91b79c64e8 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf67cc7398a4e1cb6f565ebe2241e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df96baa86bb4c51b3b8bece28e3e23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:33.252799 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-6ccd26d0-9297-4bb3-b903-0d91b79c64e8 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] 10.222.0.25 "GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e" status: 200 len: 1261 microversion: 2.1 time: 0.129665 May 27 03:44:33.253351 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 309/660] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:44:33 2021] GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e => generated 1261 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:33.494238 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-cd645739-30df-4690-9fee-d0040ba101a1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:33.494850 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-cd645739-30df-4690-9fee-d0040ba101a1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:33.502210 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-cd645739-30df-4690-9fee-d0040ba101a1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:33.502656 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-cd645739-30df-4690-9fee-d0040ba101a1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:33.503443 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-cd645739-30df-4690-9fee-d0040ba101a1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:33.503879 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-cd645739-30df-4690-9fee-d0040ba101a1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:33.692247 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-cd645739-30df-4690-9fee-d0040ba101a1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:33.700814 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-cd645739-30df-4690-9fee-d0040ba101a1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:33.702336 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-cd645739-30df-4690-9fee-d0040ba101a1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:33.704057 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-cd645739-30df-4690-9fee-d0040ba101a1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1723 microversion: 2.20 time: 0.212967 May 27 03:44:33.704651 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 352/661] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:44:33 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1723 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:44:33.842043 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-2740f8fa-cf53-4587-b535-59804bdb550a tempest-VolumesSnapshotsTestJSON-2002177494 tempest-VolumesSnapshotsTestJSON-2002177494-project] Calling method '.version_select at 0x7f98881a59d0>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:33.889551 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-2740f8fa-cf53-4587-b535-59804bdb550a tempest-VolumesSnapshotsTestJSON-2002177494 tempest-VolumesSnapshotsTestJSON-2002177494-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/6054c673-f4c6-4da2-bbd8-57ad1a6e4536" status: 200 len: 287 microversion: 2.1 time: 0.051059 May 27 03:44:33.890103 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 310/662] 10.222.0.25 () {58 vars in 1251 bytes} [Thu May 27 03:44:33 2021] GET /compute/v2.1/os-snapshots/6054c673-f4c6-4da2-bbd8-57ad1a6e4536 => generated 287 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:44:34.268853 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-68f66e97-a167-4824-be5d-9e698c5c9d1a tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:34.269460 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-68f66e97-a167-4824-be5d-9e698c5c9d1a tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] [instance: daffe717-7636-45e8-813d-8b2a6075c61e] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:34.276602 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-68f66e97-a167-4824-be5d-9e698c5c9d1a tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:34.277048 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-68f66e97-a167-4824-be5d-9e698c5c9d1a tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:34.277812 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-68f66e97-a167-4824-be5d-9e698c5c9d1a tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:34.278240 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-68f66e97-a167-4824-be5d-9e698c5c9d1a tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:34.394558 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-68f66e97-a167-4824-be5d-9e698c5c9d1a tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf67cc7398a4e1cb6f565ebe2241e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df96baa86bb4c51b3b8bece28e3e23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:34.403328 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-68f66e97-a167-4824-be5d-9e698c5c9d1a tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] 10.222.0.25 "GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e" status: 200 len: 1253 microversion: 2.1 time: 0.138043 May 27 03:44:34.403832 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 353/663] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:44:34 2021] GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e => generated 1253 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:34.721931 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-efcc13ee-4ccb-4146-8559-87eacdd5278b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:34.722549 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-efcc13ee-4ccb-4146-8559-87eacdd5278b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:34.730437 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-efcc13ee-4ccb-4146-8559-87eacdd5278b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:34.730892 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-efcc13ee-4ccb-4146-8559-87eacdd5278b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:34.731665 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-efcc13ee-4ccb-4146-8559-87eacdd5278b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:34.732147 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-efcc13ee-4ccb-4146-8559-87eacdd5278b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:34.904200 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-0c04dd1e-2961-4635-9bcc-9adeb3b334fa tempest-VolumesSnapshotsTestJSON-2002177494 tempest-VolumesSnapshotsTestJSON-2002177494-project] Calling method '.version_select at 0x7f9888138700>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:34.946348 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-efcc13ee-4ccb-4146-8559-87eacdd5278b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:34.949596 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-0c04dd1e-2961-4635-9bcc-9adeb3b334fa tempest-VolumesSnapshotsTestJSON-2002177494 tempest-VolumesSnapshotsTestJSON-2002177494-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/6054c673-f4c6-4da2-bbd8-57ad1a6e4536" status: 200 len: 287 microversion: 2.1 time: 0.046473 May 27 03:44:34.949596 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 354/664] 10.222.0.25 () {58 vars in 1251 bytes} [Thu May 27 03:44:34 2021] GET /compute/v2.1/os-snapshots/6054c673-f4c6-4da2-bbd8-57ad1a6e4536 => generated 287 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:44:34.956041 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-efcc13ee-4ccb-4146-8559-87eacdd5278b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:34.957983 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-efcc13ee-4ccb-4146-8559-87eacdd5278b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:34.959161 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-efcc13ee-4ccb-4146-8559-87eacdd5278b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1723 microversion: 2.20 time: 0.241433 May 27 03:44:34.959707 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 311/665] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:44:34 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1723 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:44:35.424492 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-742ff269-d079-4c01-9ba4-d0cfed5ce6f6 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:35.425112 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-742ff269-d079-4c01-9ba4-d0cfed5ce6f6 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] [instance: daffe717-7636-45e8-813d-8b2a6075c61e] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:35.432476 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-742ff269-d079-4c01-9ba4-d0cfed5ce6f6 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:35.432929 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-742ff269-d079-4c01-9ba4-d0cfed5ce6f6 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:35.433699 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-742ff269-d079-4c01-9ba4-d0cfed5ce6f6 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:35.434139 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-742ff269-d079-4c01-9ba4-d0cfed5ce6f6 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:35.542835 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-742ff269-d079-4c01-9ba4-d0cfed5ce6f6 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf67cc7398a4e1cb6f565ebe2241e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df96baa86bb4c51b3b8bece28e3e23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:35.551042 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-742ff269-d079-4c01-9ba4-d0cfed5ce6f6 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] 10.222.0.25 "GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e" status: 200 len: 1253 microversion: 2.1 time: 0.130349 May 27 03:44:35.551597 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 355/666] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:44:35 2021] GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e => generated 1253 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:35.958446 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-37d584c3-cf23-44da-bc3a-b9f724f16972 tempest-VolumesSnapshotsTestJSON-2002177494 tempest-VolumesSnapshotsTestJSON-2002177494-project] Calling method '.version_select at 0x7f988805d820>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:35.977745 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-bb372f96-7ee9-45a8-9aac-1e517f8d69af tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:35.978431 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-bb372f96-7ee9-45a8-9aac-1e517f8d69af tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:35.986571 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-bb372f96-7ee9-45a8-9aac-1e517f8d69af tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:35.987022 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-bb372f96-7ee9-45a8-9aac-1e517f8d69af tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:35.987789 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-bb372f96-7ee9-45a8-9aac-1e517f8d69af tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:35.988225 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-bb372f96-7ee9-45a8-9aac-1e517f8d69af tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:36.002690 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-37d584c3-cf23-44da-bc3a-b9f724f16972 tempest-VolumesSnapshotsTestJSON-2002177494 tempest-VolumesSnapshotsTestJSON-2002177494-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/6054c673-f4c6-4da2-bbd8-57ad1a6e4536" status: 200 len: 287 microversion: 2.1 time: 0.047784 May 27 03:44:36.003270 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 312/667] 10.222.0.25 () {58 vars in 1251 bytes} [Thu May 27 03:44:35 2021] GET /compute/v2.1/os-snapshots/6054c673-f4c6-4da2-bbd8-57ad1a6e4536 => generated 287 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:44:36.179326 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-bb372f96-7ee9-45a8-9aac-1e517f8d69af tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:36.187840 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-bb372f96-7ee9-45a8-9aac-1e517f8d69af tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:36.189389 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-bb372f96-7ee9-45a8-9aac-1e517f8d69af tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:36.190518 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-bb372f96-7ee9-45a8-9aac-1e517f8d69af tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1723 microversion: 2.20 time: 0.216639 May 27 03:44:36.191074 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 356/668] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:44:35 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1723 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:44:36.567842 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-2e89b523-a236-45b2-af81-7bf314e5b6b8 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:36.568489 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-2e89b523-a236-45b2-af81-7bf314e5b6b8 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] [instance: daffe717-7636-45e8-813d-8b2a6075c61e] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:36.575843 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2e89b523-a236-45b2-af81-7bf314e5b6b8 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:36.576306 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2e89b523-a236-45b2-af81-7bf314e5b6b8 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:36.577124 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2e89b523-a236-45b2-af81-7bf314e5b6b8 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:36.577573 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2e89b523-a236-45b2-af81-7bf314e5b6b8 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:36.687036 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-2e89b523-a236-45b2-af81-7bf314e5b6b8 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf67cc7398a4e1cb6f565ebe2241e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df96baa86bb4c51b3b8bece28e3e23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:36.695838 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-2e89b523-a236-45b2-af81-7bf314e5b6b8 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] 10.222.0.25 "GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e" status: 200 len: 1309 microversion: 2.1 time: 0.131920 May 27 03:44:36.696414 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 313/669] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:44:36 2021] GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e => generated 1309 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:37.014160 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-cbc696c4-4728-4130-8451-a36854c865f4 tempest-VolumesSnapshotsTestJSON-2002177494 tempest-VolumesSnapshotsTestJSON-2002177494-project] Calling method '.version_select at 0x7f988817f280>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:37.066202 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-cbc696c4-4728-4130-8451-a36854c865f4 tempest-VolumesSnapshotsTestJSON-2002177494 tempest-VolumesSnapshotsTestJSON-2002177494-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/6054c673-f4c6-4da2-bbd8-57ad1a6e4536" status: 200 len: 288 microversion: 2.1 time: 0.055590 May 27 03:44:37.066833 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 357/670] 10.222.0.25 () {58 vars in 1251 bytes} [Thu May 27 03:44:37 2021] GET /compute/v2.1/os-snapshots/6054c673-f4c6-4da2-bbd8-57ad1a6e4536 => generated 288 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:44:37.076762 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-f9693fd1-d669-4ba7-9000-c4083e76deef tempest-VolumesSnapshotsTestJSON-2002177494 tempest-VolumesSnapshotsTestJSON-2002177494-project] Calling method '.version_select at 0x7f988805d5e0>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:37.208006 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-9b5bdbc2-5dba-4e11-b490-17a4f247ea15 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:37.208780 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-9b5bdbc2-5dba-4e11-b490-17a4f247ea15 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:37.216173 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9b5bdbc2-5dba-4e11-b490-17a4f247ea15 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:37.216660 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9b5bdbc2-5dba-4e11-b490-17a4f247ea15 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:37.217441 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9b5bdbc2-5dba-4e11-b490-17a4f247ea15 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:37.217883 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9b5bdbc2-5dba-4e11-b490-17a4f247ea15 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:37.262198 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-f9693fd1-d669-4ba7-9000-c4083e76deef tempest-VolumesSnapshotsTestJSON-2002177494 tempest-VolumesSnapshotsTestJSON-2002177494-project] 10.222.0.25 "DELETE /compute/v2.1/os-snapshots/6054c673-f4c6-4da2-bbd8-57ad1a6e4536" status: 202 len: 0 microversion: 2.1 time: 0.189050 May 27 03:44:37.266605 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 314/671] 10.222.0.25 () {58 vars in 1254 bytes} [Thu May 27 03:44:37 2021] DELETE /compute/v2.1/os-snapshots/6054c673-f4c6-4da2-bbd8-57ad1a6e4536 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:44:37.271311 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-b598beaa-a267-4713-92c5-92e742328a14 tempest-VolumesSnapshotsTestJSON-2002177494 tempest-VolumesSnapshotsTestJSON-2002177494-project] Calling method '.version_select at 0x7f98881a58b0>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:37.316284 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-b598beaa-a267-4713-92c5-92e742328a14 tempest-VolumesSnapshotsTestJSON-2002177494 tempest-VolumesSnapshotsTestJSON-2002177494-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/6054c673-f4c6-4da2-bbd8-57ad1a6e4536" status: 200 len: 287 microversion: 2.1 time: 0.048370 May 27 03:44:37.316889 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 315/672] 10.222.0.25 () {58 vars in 1251 bytes} [Thu May 27 03:44:37 2021] GET /compute/v2.1/os-snapshots/6054c673-f4c6-4da2-bbd8-57ad1a6e4536 => generated 287 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:44:37.435307 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-9b5bdbc2-5dba-4e11-b490-17a4f247ea15 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:37.457750 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-9b5bdbc2-5dba-4e11-b490-17a4f247ea15 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:37.459313 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-9b5bdbc2-5dba-4e11-b490-17a4f247ea15 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:37.460474 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-9b5bdbc2-5dba-4e11-b490-17a4f247ea15 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1723 microversion: 2.20 time: 0.256166 May 27 03:44:37.465127 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 358/673] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:44:37 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1723 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:44:37.712155 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-556d2c05-3ee8-4a28-ace0-7d74a4583796 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:37.712931 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-556d2c05-3ee8-4a28-ace0-7d74a4583796 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] [instance: daffe717-7636-45e8-813d-8b2a6075c61e] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:37.725328 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-556d2c05-3ee8-4a28-ace0-7d74a4583796 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:37.725826 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-556d2c05-3ee8-4a28-ace0-7d74a4583796 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:37.726577 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-556d2c05-3ee8-4a28-ace0-7d74a4583796 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:37.727231 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-556d2c05-3ee8-4a28-ace0-7d74a4583796 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:37.886307 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-556d2c05-3ee8-4a28-ace0-7d74a4583796 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf67cc7398a4e1cb6f565ebe2241e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df96baa86bb4c51b3b8bece28e3e23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:37.894988 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-556d2c05-3ee8-4a28-ace0-7d74a4583796 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] 10.222.0.25 "GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e" status: 200 len: 1327 microversion: 2.1 time: 0.186268 May 27 03:44:37.895640 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 316/674] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:44:37 2021] GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e => generated 1327 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:38.327704 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-98e10f72-002a-4619-8a65-9197e571169f tempest-VolumesSnapshotsTestJSON-2002177494 tempest-VolumesSnapshotsTestJSON-2002177494-project] Calling method '.version_select at 0x7f988817f160>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:38.368338 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.wsgi [None req-98e10f72-002a-4619-8a65-9197e571169f tempest-VolumesSnapshotsTestJSON-2002177494 tempest-VolumesSnapshotsTestJSON-2002177494-project] HTTP exception thrown: Snapshot 6054c673-f4c6-4da2-bbd8-57ad1a6e4536 could not be found. May 27 03:44:38.369159 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-98e10f72-002a-4619-8a65-9197e571169f tempest-VolumesSnapshotsTestJSON-2002177494 tempest-VolumesSnapshotsTestJSON-2002177494-project] Returning 404 to user: Snapshot 6054c673-f4c6-4da2-bbd8-57ad1a6e4536 could not be found. {{(pid=113020) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 27 03:44:38.370179 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-98e10f72-002a-4619-8a65-9197e571169f tempest-VolumesSnapshotsTestJSON-2002177494 tempest-VolumesSnapshotsTestJSON-2002177494-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/6054c673-f4c6-4da2-bbd8-57ad1a6e4536" status: 404 len: 111 microversion: 2.1 time: 0.046273 May 27 03:44:38.370976 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 359/675] 10.222.0.25 () {58 vars in 1251 bytes} [Thu May 27 03:44:38 2021] GET /compute/v2.1/os-snapshots/6054c673-f4c6-4da2-bbd8-57ad1a6e4536 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:44:38.379019 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-a04289fe-9aae-4545-9321-3b57d9e83f15 tempest-VolumesSnapshotsTestJSON-2002177494 tempest-VolumesSnapshotsTestJSON-2002177494-project] Calling method '.version_select at 0x7f988805d820>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:38.478581 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-e23ef1b7-c568-4238-81b3-27763dde5471 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:38.479422 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-e23ef1b7-c568-4238-81b3-27763dde5471 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:38.491437 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e23ef1b7-c568-4238-81b3-27763dde5471 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:38.492061 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e23ef1b7-c568-4238-81b3-27763dde5471 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:38.493238 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e23ef1b7-c568-4238-81b3-27763dde5471 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:38.493843 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e23ef1b7-c568-4238-81b3-27763dde5471 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:38.714970 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-e23ef1b7-c568-4238-81b3-27763dde5471 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:38.743220 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-e23ef1b7-c568-4238-81b3-27763dde5471 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:38.746316 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-e23ef1b7-c568-4238-81b3-27763dde5471 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:38.749230 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-e23ef1b7-c568-4238-81b3-27763dde5471 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1723 microversion: 2.20 time: 0.273563 May 27 03:44:38.755157 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 360/676] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:44:38 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1723 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:44:38.769793 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-1b3ed70d-371b-4686-abe6-a1ebb4252ddf tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:44:38.783081 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-a04289fe-9aae-4545-9321-3b57d9e83f15 tempest-VolumesSnapshotsTestJSON-2002177494 tempest-VolumesSnapshotsTestJSON-2002177494-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/a0566a01-d08e-4cce-ad28-11cfb8c1795d" status: 202 len: 0 microversion: 2.1 time: 0.404769 May 27 03:44:38.783081 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 317/677] 10.222.0.25 () {58 vars in 1248 bytes} [Thu May 27 03:44:38 2021] DELETE /compute/v2.1/os-volumes/a0566a01-d08e-4cce-ad28-11cfb8c1795d => generated 0 bytes in 406 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:44:38.783235 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1b3ed70d-371b-4686-abe6-a1ebb4252ddf tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:38.790992 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-c5f83345-fe09-45e3-9600-95e463b4f4e7 tempest-VolumesSnapshotsTestJSON-2002177494 tempest-VolumesSnapshotsTestJSON-2002177494-project] Calling method '.version_select at 0x7f987bf469d0>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:38.792567 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1b3ed70d-371b-4686-abe6-a1ebb4252ddf tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:38.926824 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-1b3ed70d-371b-4686-abe6-a1ebb4252ddf tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Going to try to stop instance {{(pid=113020) force_stop /opt/stack/nova/nova/compute/api.py:2579}} May 27 03:44:38.979354 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-c5f83345-fe09-45e3-9600-95e463b4f4e7 tempest-VolumesSnapshotsTestJSON-2002177494 tempest-VolumesSnapshotsTestJSON-2002177494-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/a0566a01-d08e-4cce-ad28-11cfb8c1795d" status: 200 len: 345 microversion: 2.1 time: 0.193183 May 27 03:44:38.980191 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 318/678] 10.222.0.25 () {58 vars in 1245 bytes} [Thu May 27 03:44:38 2021] GET /compute/v2.1/os-volumes/a0566a01-d08e-4cce-ad28-11cfb8c1795d => generated 345 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:44:38.985276 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-ea2d15b0-2fef-4dff-a4e0-05bb128cbd6c tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:38.986200 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-ea2d15b0-2fef-4dff-a4e0-05bb128cbd6c tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] [instance: daffe717-7636-45e8-813d-8b2a6075c61e] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:39.006782 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ea2d15b0-2fef-4dff-a4e0-05bb128cbd6c tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:39.007652 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ea2d15b0-2fef-4dff-a4e0-05bb128cbd6c tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:39.008996 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ea2d15b0-2fef-4dff-a4e0-05bb128cbd6c tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:39.009680 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ea2d15b0-2fef-4dff-a4e0-05bb128cbd6c tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:39.182683 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-1b3ed70d-371b-4686-abe6-a1ebb4252ddf tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 202 len: 0 microversion: 2.1 time: 0.425426 May 27 03:44:39.186253 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 361/679] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:44:38 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 0 bytes in 428 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:44:39.193196 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-7ddcf20c-8648-499b-8041-1b79c15472b4 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:39.193986 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-7ddcf20c-8648-499b-8041-1b79c15472b4 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:39.206083 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7ddcf20c-8648-499b-8041-1b79c15472b4 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:39.206614 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7ddcf20c-8648-499b-8041-1b79c15472b4 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:39.207529 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7ddcf20c-8648-499b-8041-1b79c15472b4 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:39.208381 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7ddcf20c-8648-499b-8041-1b79c15472b4 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:39.475119 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-7ddcf20c-8648-499b-8041-1b79c15472b4 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:39.485489 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-7ddcf20c-8648-499b-8041-1b79c15472b4 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1723 microversion: 2.1 time: 0.296836 May 27 03:44:39.486711 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 362/680] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:44:39 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1723 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:39.529366 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-ea2d15b0-2fef-4dff-a4e0-05bb128cbd6c tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf67cc7398a4e1cb6f565ebe2241e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df96baa86bb4c51b3b8bece28e3e23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:39.541686 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-ea2d15b0-2fef-4dff-a4e0-05bb128cbd6c tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] 10.222.0.25 "GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e" status: 200 len: 1357 microversion: 2.1 time: 0.560096 May 27 03:44:39.552011 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 319/681] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:44:38 2021] GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e => generated 1357 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:39.775809 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-52b2376b-29c1-452b-a566-92437e1b08af tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:39.776208 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-52b2376b-29c1-452b-a566-92437e1b08af tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:39.784812 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-52b2376b-29c1-452b-a566-92437e1b08af tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:39.785267 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-52b2376b-29c1-452b-a566-92437e1b08af tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:39.786055 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-52b2376b-29c1-452b-a566-92437e1b08af tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:39.786495 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-52b2376b-29c1-452b-a566-92437e1b08af tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:39.997924 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-19b3ebde-47c6-41b0-a3f3-21e29cd946fe tempest-VolumesSnapshotsTestJSON-2002177494 tempest-VolumesSnapshotsTestJSON-2002177494-project] Calling method '.version_select at 0x7f987bd0daf0>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:40.068817 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-52b2376b-29c1-452b-a566-92437e1b08af tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:40.078993 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-52b2376b-29c1-452b-a566-92437e1b08af tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:40.080890 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-52b2376b-29c1-452b-a566-92437e1b08af tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:40.082158 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-52b2376b-29c1-452b-a566-92437e1b08af tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1723 microversion: 2.20 time: 0.310594 May 27 03:44:40.092788 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 363/682] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:44:39 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1723 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:44:40.099620 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.wsgi [None req-19b3ebde-47c6-41b0-a3f3-21e29cd946fe tempest-VolumesSnapshotsTestJSON-2002177494 tempest-VolumesSnapshotsTestJSON-2002177494-project] HTTP exception thrown: Volume a0566a01-d08e-4cce-ad28-11cfb8c1795d could not be found. May 27 03:44:40.099620 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-19b3ebde-47c6-41b0-a3f3-21e29cd946fe tempest-VolumesSnapshotsTestJSON-2002177494 tempest-VolumesSnapshotsTestJSON-2002177494-project] Returning 404 to user: Volume a0566a01-d08e-4cce-ad28-11cfb8c1795d could not be found. {{(pid=113021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 27 03:44:40.099620 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-19b3ebde-47c6-41b0-a3f3-21e29cd946fe tempest-VolumesSnapshotsTestJSON-2002177494 tempest-VolumesSnapshotsTestJSON-2002177494-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/a0566a01-d08e-4cce-ad28-11cfb8c1795d" status: 404 len: 109 microversion: 2.1 time: 0.110083 May 27 03:44:40.099620 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 320/683] 10.222.0.25 () {58 vars in 1245 bytes} [Thu May 27 03:44:39 2021] GET /compute/v2.1/os-volumes/a0566a01-d08e-4cce-ad28-11cfb8c1795d => generated 109 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 03:44:40.113907 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-15a13be5-623f-45a3-bdeb-64229e105cb6 tempest-VolumesSnapshotsTestJSON-2002177494 tempest-VolumesSnapshotsTestJSON-2002177494-project] Calling method '.version_select at 0x7f987beb4af0>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:40.179892 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.wsgi [None req-15a13be5-623f-45a3-bdeb-64229e105cb6 tempest-VolumesSnapshotsTestJSON-2002177494 tempest-VolumesSnapshotsTestJSON-2002177494-project] HTTP exception thrown: Volume a0566a01-d08e-4cce-ad28-11cfb8c1795d could not be found. May 27 03:44:40.180539 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-15a13be5-623f-45a3-bdeb-64229e105cb6 tempest-VolumesSnapshotsTestJSON-2002177494 tempest-VolumesSnapshotsTestJSON-2002177494-project] Returning 404 to user: Volume a0566a01-d08e-4cce-ad28-11cfb8c1795d could not be found. {{(pid=113020) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 27 03:44:40.181380 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-15a13be5-623f-45a3-bdeb-64229e105cb6 tempest-VolumesSnapshotsTestJSON-2002177494 tempest-VolumesSnapshotsTestJSON-2002177494-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/a0566a01-d08e-4cce-ad28-11cfb8c1795d" status: 404 len: 109 microversion: 2.1 time: 0.071244 May 27 03:44:40.181917 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 364/684] 10.222.0.25 () {58 vars in 1248 bytes} [Thu May 27 03:44:40 2021] DELETE /compute/v2.1/os-volumes/a0566a01-d08e-4cce-ad28-11cfb8c1795d => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:44:40.190930 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-eda6c1eb-09f8-445c-9c14-65829a2da322 tempest-VolumesSnapshotsTestJSON-2002177494 tempest-VolumesSnapshotsTestJSON-2002177494-project] Calling method '.version_select at 0x7f987bf46280>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:40.229917 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [req-8528b582-31d4-4610-9163-7997279659a4 req-ad54157d-93e7-40b9-b582-363a8f7f9951 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "daffe717-7636-45e8-813d-8b2a6075c61e", "tag": "2beacebc-a476-4d0c-ad0f-528ef5b957c8"}]} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:44:40.231497 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:44:40.231497 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: warnings.warn(msg) May 27 03:44:40.246733 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-8528b582-31d4-4610-9163-7997279659a4 req-ad54157d-93e7-40b9-b582-363a8f7f9951 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:40.247197 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-8528b582-31d4-4610-9163-7997279659a4 req-ad54157d-93e7-40b9-b582-363a8f7f9951 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:40.261622 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.wsgi [None req-eda6c1eb-09f8-445c-9c14-65829a2da322 tempest-VolumesSnapshotsTestJSON-2002177494 tempest-VolumesSnapshotsTestJSON-2002177494-project] HTTP exception thrown: Volume a0566a01-d08e-4cce-ad28-11cfb8c1795d could not be found. May 27 03:44:40.262232 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-eda6c1eb-09f8-445c-9c14-65829a2da322 tempest-VolumesSnapshotsTestJSON-2002177494 tempest-VolumesSnapshotsTestJSON-2002177494-project] Returning 404 to user: Volume a0566a01-d08e-4cce-ad28-11cfb8c1795d could not be found. {{(pid=113021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 27 03:44:40.263067 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-eda6c1eb-09f8-445c-9c14-65829a2da322 tempest-VolumesSnapshotsTestJSON-2002177494 tempest-VolumesSnapshotsTestJSON-2002177494-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/a0566a01-d08e-4cce-ad28-11cfb8c1795d" status: 404 len: 109 microversion: 2.1 time: 0.076776 May 27 03:44:40.264089 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 321/685] 10.222.0.25 () {58 vars in 1245 bytes} [Thu May 27 03:44:40 2021] GET /compute/v2.1/os-volumes/a0566a01-d08e-4cce-ad28-11cfb8c1795d => generated 109 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:44:40.281166 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.compute.server_external_events [req-8528b582-31d4-4610-9163-7997279659a4 req-ad54157d-93e7-40b9-b582-363a8f7f9951 service nova] Creating event network-changed:2beacebc-a476-4d0c-ad0f-528ef5b957c8 for instance daffe717-7636-45e8-813d-8b2a6075c61e on hv-cinder-79326 May 27 03:44:40.281166 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [req-8528b582-31d4-4610-9163-7997279659a4 req-ad54157d-93e7-40b9-b582-363a8f7f9951 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053579 May 27 03:44:40.281166 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 365/686] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:44:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:44:40.503667 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-b615bb39-fabf-46ec-96f4-025d9d5d0a24 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:40.504294 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-b615bb39-fabf-46ec-96f4-025d9d5d0a24 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:40.512319 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b615bb39-fabf-46ec-96f4-025d9d5d0a24 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:40.513003 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b615bb39-fabf-46ec-96f4-025d9d5d0a24 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:40.514034 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b615bb39-fabf-46ec-96f4-025d9d5d0a24 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:40.514683 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b615bb39-fabf-46ec-96f4-025d9d5d0a24 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:40.560127 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-388cefab-e6b7-4223-814e-3c30eea2b178 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:40.561649 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-388cefab-e6b7-4223-814e-3c30eea2b178 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] [instance: daffe717-7636-45e8-813d-8b2a6075c61e] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:40.571247 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-388cefab-e6b7-4223-814e-3c30eea2b178 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:40.571703 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-388cefab-e6b7-4223-814e-3c30eea2b178 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:40.572716 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-388cefab-e6b7-4223-814e-3c30eea2b178 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:40.573346 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-388cefab-e6b7-4223-814e-3c30eea2b178 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:40.875632 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-b615bb39-fabf-46ec-96f4-025d9d5d0a24 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:40.885345 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-b615bb39-fabf-46ec-96f4-025d9d5d0a24 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1723 microversion: 2.1 time: 0.386529 May 27 03:44:40.888984 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 322/687] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:44:40 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1723 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:40.960142 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-388cefab-e6b7-4223-814e-3c30eea2b178 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf67cc7398a4e1cb6f565ebe2241e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df96baa86bb4c51b3b8bece28e3e23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:40.971958 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-388cefab-e6b7-4223-814e-3c30eea2b178 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] 10.222.0.25 "GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e" status: 200 len: 1357 microversion: 2.1 time: 0.416462 May 27 03:44:40.992346 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 366/688] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:44:40 2021] GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e => generated 1357 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:44:41.101023 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-0a210077-bfd6-42a3-80cb-81a5579e25d4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:41.101673 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-0a210077-bfd6-42a3-80cb-81a5579e25d4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:41.114293 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-0a210077-bfd6-42a3-80cb-81a5579e25d4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:41.114293 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-0a210077-bfd6-42a3-80cb-81a5579e25d4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:41.114293 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-0a210077-bfd6-42a3-80cb-81a5579e25d4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:41.114293 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-0a210077-bfd6-42a3-80cb-81a5579e25d4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:41.432626 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-0a210077-bfd6-42a3-80cb-81a5579e25d4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:41.447612 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-0a210077-bfd6-42a3-80cb-81a5579e25d4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:41.449268 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-0a210077-bfd6-42a3-80cb-81a5579e25d4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:41.452696 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-0a210077-bfd6-42a3-80cb-81a5579e25d4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1723 microversion: 2.20 time: 0.353315 May 27 03:44:41.461159 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 323/689] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:44:41 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1723 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:44:41.903888 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-e79abf9c-ceab-484a-a87e-46e9836186b4 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:41.904528 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-e79abf9c-ceab-484a-a87e-46e9836186b4 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:41.912049 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e79abf9c-ceab-484a-a87e-46e9836186b4 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:41.912686 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e79abf9c-ceab-484a-a87e-46e9836186b4 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:41.913536 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e79abf9c-ceab-484a-a87e-46e9836186b4 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:41.914326 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e79abf9c-ceab-484a-a87e-46e9836186b4 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:42.002378 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-ff2e6c19-1034-4e8f-a4f7-c06eb6e622f3 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:42.002378 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-ff2e6c19-1034-4e8f-a4f7-c06eb6e622f3 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] [instance: daffe717-7636-45e8-813d-8b2a6075c61e] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:42.008342 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ff2e6c19-1034-4e8f-a4f7-c06eb6e622f3 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:42.008990 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ff2e6c19-1034-4e8f-a4f7-c06eb6e622f3 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:42.010074 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ff2e6c19-1034-4e8f-a4f7-c06eb6e622f3 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:42.010525 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ff2e6c19-1034-4e8f-a4f7-c06eb6e622f3 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:42.219505 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-e79abf9c-ceab-484a-a87e-46e9836186b4 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:42.233339 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-e79abf9c-ceab-484a-a87e-46e9836186b4 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1723 microversion: 2.1 time: 0.333008 May 27 03:44:42.236665 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 367/690] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:44:41 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1723 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:42.285667 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-ff2e6c19-1034-4e8f-a4f7-c06eb6e622f3 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf67cc7398a4e1cb6f565ebe2241e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df96baa86bb4c51b3b8bece28e3e23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:42.294099 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-ff2e6c19-1034-4e8f-a4f7-c06eb6e622f3 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] 10.222.0.25 "GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e" status: 200 len: 1357 microversion: 2.1 time: 0.308354 May 27 03:44:42.295042 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 324/691] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:44:41 2021] GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e => generated 1357 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:44:42.470871 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-6879843b-d52b-4393-ba68-16480e084da7 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:42.471534 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-6879843b-d52b-4393-ba68-16480e084da7 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:42.479057 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6879843b-d52b-4393-ba68-16480e084da7 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:42.479588 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6879843b-d52b-4393-ba68-16480e084da7 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:42.481137 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6879843b-d52b-4393-ba68-16480e084da7 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:42.481785 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6879843b-d52b-4393-ba68-16480e084da7 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:42.708107 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-6879843b-d52b-4393-ba68-16480e084da7 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:42.715040 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-6879843b-d52b-4393-ba68-16480e084da7 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:42.716594 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-6879843b-d52b-4393-ba68-16480e084da7 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:42.717730 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-6879843b-d52b-4393-ba68-16480e084da7 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1723 microversion: 2.20 time: 0.251332 May 27 03:44:42.718495 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 368/692] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:44:42 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1723 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:44:43.253267 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-f126c9cb-4c73-4689-ae9b-9a3131c36767 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:43.253267 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-f126c9cb-4c73-4689-ae9b-9a3131c36767 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:43.268699 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f126c9cb-4c73-4689-ae9b-9a3131c36767 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:43.269226 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f126c9cb-4c73-4689-ae9b-9a3131c36767 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:43.270420 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f126c9cb-4c73-4689-ae9b-9a3131c36767 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:43.271622 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f126c9cb-4c73-4689-ae9b-9a3131c36767 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:43.317396 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-6c325b4c-6756-4767-a04e-112f5f4da9d9 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:43.318052 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-6c325b4c-6756-4767-a04e-112f5f4da9d9 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] [instance: daffe717-7636-45e8-813d-8b2a6075c61e] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:43.325834 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6c325b4c-6756-4767-a04e-112f5f4da9d9 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:43.326280 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6c325b4c-6756-4767-a04e-112f5f4da9d9 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:43.327058 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6c325b4c-6756-4767-a04e-112f5f4da9d9 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:43.327492 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6c325b4c-6756-4767-a04e-112f5f4da9d9 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:43.494907 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-f126c9cb-4c73-4689-ae9b-9a3131c36767 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:43.509763 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-f126c9cb-4c73-4689-ae9b-9a3131c36767 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1723 microversion: 2.1 time: 0.261920 May 27 03:44:43.510651 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 325/693] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:44:43 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1723 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:43.658962 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-6c325b4c-6756-4767-a04e-112f5f4da9d9 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf67cc7398a4e1cb6f565ebe2241e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df96baa86bb4c51b3b8bece28e3e23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:43.668363 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-6c325b4c-6756-4767-a04e-112f5f4da9d9 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] 10.222.0.25 "GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e" status: 200 len: 1357 microversion: 2.1 time: 0.359895 May 27 03:44:43.668960 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 369/694] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:44:43 2021] GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e => generated 1357 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:43.735726 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-4fcb1d29-4a2f-48ee-b3f5-ebe622cdf207 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:43.736374 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-4fcb1d29-4a2f-48ee-b3f5-ebe622cdf207 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:43.743909 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-4fcb1d29-4a2f-48ee-b3f5-ebe622cdf207 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:43.744373 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-4fcb1d29-4a2f-48ee-b3f5-ebe622cdf207 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:43.745173 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-4fcb1d29-4a2f-48ee-b3f5-ebe622cdf207 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:43.745617 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-4fcb1d29-4a2f-48ee-b3f5-ebe622cdf207 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:43.965833 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-4fcb1d29-4a2f-48ee-b3f5-ebe622cdf207 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:43.975877 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-4fcb1d29-4a2f-48ee-b3f5-ebe622cdf207 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:43.977466 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-4fcb1d29-4a2f-48ee-b3f5-ebe622cdf207 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:43.978629 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-4fcb1d29-4a2f-48ee-b3f5-ebe622cdf207 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1723 microversion: 2.20 time: 0.247187 May 27 03:44:43.979178 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 326/695] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:44:43 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1723 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:44:44.527135 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-f11495b1-de0a-45f6-ae40-f4ac87aa08f3 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:44.527767 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-f11495b1-de0a-45f6-ae40-f4ac87aa08f3 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:44.535072 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f11495b1-de0a-45f6-ae40-f4ac87aa08f3 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:44.536005 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f11495b1-de0a-45f6-ae40-f4ac87aa08f3 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:44.536879 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f11495b1-de0a-45f6-ae40-f4ac87aa08f3 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:44.537323 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f11495b1-de0a-45f6-ae40-f4ac87aa08f3 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:44.685979 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-837eb92e-2454-43fa-a8f8-3781e56c4e99 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:44.690376 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-837eb92e-2454-43fa-a8f8-3781e56c4e99 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] [instance: daffe717-7636-45e8-813d-8b2a6075c61e] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:44.699902 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-837eb92e-2454-43fa-a8f8-3781e56c4e99 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:44.705019 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-837eb92e-2454-43fa-a8f8-3781e56c4e99 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:44.706263 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-837eb92e-2454-43fa-a8f8-3781e56c4e99 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:44.706903 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-837eb92e-2454-43fa-a8f8-3781e56c4e99 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:44.782602 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-f11495b1-de0a-45f6-ae40-f4ac87aa08f3 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:44.792033 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-f11495b1-de0a-45f6-ae40-f4ac87aa08f3 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1723 microversion: 2.1 time: 0.268553 May 27 03:44:44.793299 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 370/696] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:44:44 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1723 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:44.934135 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-837eb92e-2454-43fa-a8f8-3781e56c4e99 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf67cc7398a4e1cb6f565ebe2241e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df96baa86bb4c51b3b8bece28e3e23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:44.944494 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-837eb92e-2454-43fa-a8f8-3781e56c4e99 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] 10.222.0.25 "GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e" status: 200 len: 1357 microversion: 2.1 time: 0.262800 May 27 03:44:44.945080 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 327/697] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:44:44 2021] GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e => generated 1357 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:44:44.996705 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-b12223d2-f2f3-4044-add8-8f5c312087a6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:44.997530 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-b12223d2-f2f3-4044-add8-8f5c312087a6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:45.005520 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b12223d2-f2f3-4044-add8-8f5c312087a6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:45.006203 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b12223d2-f2f3-4044-add8-8f5c312087a6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:45.007228 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b12223d2-f2f3-4044-add8-8f5c312087a6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:45.007919 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b12223d2-f2f3-4044-add8-8f5c312087a6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:45.226373 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-b12223d2-f2f3-4044-add8-8f5c312087a6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:45.236774 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-b12223d2-f2f3-4044-add8-8f5c312087a6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:45.238389 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-b12223d2-f2f3-4044-add8-8f5c312087a6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:45.239707 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-b12223d2-f2f3-4044-add8-8f5c312087a6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1723 microversion: 2.20 time: 0.246753 May 27 03:44:45.240156 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 371/698] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:44:44 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1723 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:44:45.809845 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-81ddb793-ce35-42cd-812f-e521822308b6 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:45.810666 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-81ddb793-ce35-42cd-812f-e521822308b6 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:45.818556 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-81ddb793-ce35-42cd-812f-e521822308b6 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:45.819050 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-81ddb793-ce35-42cd-812f-e521822308b6 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:45.819846 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-81ddb793-ce35-42cd-812f-e521822308b6 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:45.820257 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-81ddb793-ce35-42cd-812f-e521822308b6 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:45.961165 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-58fa778d-a9ff-436a-8b3f-a1614494004b tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:45.961829 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-58fa778d-a9ff-436a-8b3f-a1614494004b tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] [instance: daffe717-7636-45e8-813d-8b2a6075c61e] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:45.969168 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-58fa778d-a9ff-436a-8b3f-a1614494004b tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:45.969613 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-58fa778d-a9ff-436a-8b3f-a1614494004b tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:45.970389 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-58fa778d-a9ff-436a-8b3f-a1614494004b tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:45.970827 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-58fa778d-a9ff-436a-8b3f-a1614494004b tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:46.047979 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-81ddb793-ce35-42cd-812f-e521822308b6 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:46.057565 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-81ddb793-ce35-42cd-812f-e521822308b6 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1723 microversion: 2.1 time: 0.251374 May 27 03:44:46.058770 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 328/699] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:44:45 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1723 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:46.194763 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-58fa778d-a9ff-436a-8b3f-a1614494004b tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf67cc7398a4e1cb6f565ebe2241e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df96baa86bb4c51b3b8bece28e3e23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:46.212611 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-58fa778d-a9ff-436a-8b3f-a1614494004b tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] 10.222.0.25 "GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e" status: 200 len: 1357 microversion: 2.1 time: 0.255082 May 27 03:44:46.223524 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 372/700] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:44:45 2021] GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e => generated 1357 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:44:46.259205 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-6c8a027f-59a8-41da-9954-5d6479dff884 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:46.259803 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-6c8a027f-59a8-41da-9954-5d6479dff884 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:46.277737 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6c8a027f-59a8-41da-9954-5d6479dff884 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:46.278291 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6c8a027f-59a8-41da-9954-5d6479dff884 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:46.279219 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6c8a027f-59a8-41da-9954-5d6479dff884 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:46.279825 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6c8a027f-59a8-41da-9954-5d6479dff884 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:46.509470 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-6c8a027f-59a8-41da-9954-5d6479dff884 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:46.518790 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-6c8a027f-59a8-41da-9954-5d6479dff884 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:46.520312 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-6c8a027f-59a8-41da-9954-5d6479dff884 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:46.521610 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-6c8a027f-59a8-41da-9954-5d6479dff884 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1723 microversion: 2.20 time: 0.266078 May 27 03:44:46.522036 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 329/701] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:44:46 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1723 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:44:47.075031 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-bbfd7331-59ad-4095-b80d-697bcf9ca307 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:47.076476 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-bbfd7331-59ad-4095-b80d-697bcf9ca307 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:47.095653 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-bbfd7331-59ad-4095-b80d-697bcf9ca307 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:47.096260 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-bbfd7331-59ad-4095-b80d-697bcf9ca307 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:47.098135 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-bbfd7331-59ad-4095-b80d-697bcf9ca307 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:47.100714 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-bbfd7331-59ad-4095-b80d-697bcf9ca307 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:47.229609 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-4f9babb5-33f5-4a57-8b35-c4993367d1bc tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:47.231450 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-4f9babb5-33f5-4a57-8b35-c4993367d1bc tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] [instance: daffe717-7636-45e8-813d-8b2a6075c61e] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:47.237906 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-4f9babb5-33f5-4a57-8b35-c4993367d1bc tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:47.238370 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-4f9babb5-33f5-4a57-8b35-c4993367d1bc tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:47.239333 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-4f9babb5-33f5-4a57-8b35-c4993367d1bc tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:47.239778 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-4f9babb5-33f5-4a57-8b35-c4993367d1bc tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:47.392880 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-bbfd7331-59ad-4095-b80d-697bcf9ca307 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:47.402877 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-bbfd7331-59ad-4095-b80d-697bcf9ca307 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1723 microversion: 2.1 time: 0.331432 May 27 03:44:47.412413 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 373/702] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:44:47 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1723 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:47.541291 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-4f9babb5-33f5-4a57-8b35-c4993367d1bc tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf67cc7398a4e1cb6f565ebe2241e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df96baa86bb4c51b3b8bece28e3e23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:47.541487 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-7b759733-a149-4a30-a7d6-c0ec9abd29bb tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:47.542159 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-7b759733-a149-4a30-a7d6-c0ec9abd29bb tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:47.551019 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-4f9babb5-33f5-4a57-8b35-c4993367d1bc tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] 10.222.0.25 "GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e" status: 200 len: 1357 microversion: 2.1 time: 0.325154 May 27 03:44:47.551470 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7b759733-a149-4a30-a7d6-c0ec9abd29bb tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:47.551590 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7b759733-a149-4a30-a7d6-c0ec9abd29bb tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:47.551977 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 330/703] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:44:47 2021] GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e => generated 1357 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:44:47.552278 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7b759733-a149-4a30-a7d6-c0ec9abd29bb tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:47.552743 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7b759733-a149-4a30-a7d6-c0ec9abd29bb tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:47.796521 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-7b759733-a149-4a30-a7d6-c0ec9abd29bb tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:47.809603 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-7b759733-a149-4a30-a7d6-c0ec9abd29bb tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:47.814075 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-7b759733-a149-4a30-a7d6-c0ec9abd29bb tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:47.816359 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-7b759733-a149-4a30-a7d6-c0ec9abd29bb tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1723 microversion: 2.20 time: 0.279004 May 27 03:44:47.819008 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 374/704] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:44:47 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1723 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:44:48.420029 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-11825c4f-5332-473d-b4d8-9a16640dc633 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:48.431784 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-11825c4f-5332-473d-b4d8-9a16640dc633 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:48.431784 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-11825c4f-5332-473d-b4d8-9a16640dc633 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:48.431784 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-11825c4f-5332-473d-b4d8-9a16640dc633 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:48.431784 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-11825c4f-5332-473d-b4d8-9a16640dc633 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:48.432206 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-11825c4f-5332-473d-b4d8-9a16640dc633 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:48.569810 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-1aa4a1c0-ee20-4789-b5fc-f420ea06ab94 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:48.571856 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-1aa4a1c0-ee20-4789-b5fc-f420ea06ab94 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] [instance: daffe717-7636-45e8-813d-8b2a6075c61e] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:48.584936 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1aa4a1c0-ee20-4789-b5fc-f420ea06ab94 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:48.591759 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1aa4a1c0-ee20-4789-b5fc-f420ea06ab94 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:48.591759 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1aa4a1c0-ee20-4789-b5fc-f420ea06ab94 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:48.591759 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1aa4a1c0-ee20-4789-b5fc-f420ea06ab94 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:48.672778 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-11825c4f-5332-473d-b4d8-9a16640dc633 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:48.681579 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-11825c4f-5332-473d-b4d8-9a16640dc633 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1723 microversion: 2.1 time: 0.266066 May 27 03:44:48.682153 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 331/705] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:44:48 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1723 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:48.831274 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-1aa4a1c0-ee20-4789-b5fc-f420ea06ab94 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf67cc7398a4e1cb6f565ebe2241e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df96baa86bb4c51b3b8bece28e3e23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:48.839116 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-0c5d6316-bd69-468e-83b9-56af421fe012 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:48.839749 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-0c5d6316-bd69-468e-83b9-56af421fe012 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:48.839872 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-1aa4a1c0-ee20-4789-b5fc-f420ea06ab94 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] 10.222.0.25 "GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e" status: 200 len: 1357 microversion: 2.1 time: 0.274528 May 27 03:44:48.840614 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 375/706] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:44:48 2021] GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e => generated 1357 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:48.848223 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-0c5d6316-bd69-468e-83b9-56af421fe012 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:48.849146 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-0c5d6316-bd69-468e-83b9-56af421fe012 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:48.850151 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-0c5d6316-bd69-468e-83b9-56af421fe012 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:48.850802 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-0c5d6316-bd69-468e-83b9-56af421fe012 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:49.097982 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-0c5d6316-bd69-468e-83b9-56af421fe012 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:49.110353 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-0c5d6316-bd69-468e-83b9-56af421fe012 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:49.112597 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-0c5d6316-bd69-468e-83b9-56af421fe012 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:49.114125 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-0c5d6316-bd69-468e-83b9-56af421fe012 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1723 microversion: 2.20 time: 0.281166 May 27 03:44:49.126560 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 332/707] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:44:48 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1723 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:44:49.699165 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-d9c4dee4-caae-4ff5-8e9e-8e6d77239634 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:49.701420 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-d9c4dee4-caae-4ff5-8e9e-8e6d77239634 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:49.707625 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d9c4dee4-caae-4ff5-8e9e-8e6d77239634 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:49.708014 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d9c4dee4-caae-4ff5-8e9e-8e6d77239634 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:49.708829 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d9c4dee4-caae-4ff5-8e9e-8e6d77239634 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:49.709275 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d9c4dee4-caae-4ff5-8e9e-8e6d77239634 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:49.856813 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-ae9cea74-d969-4648-8f9e-b2a524a043eb tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:49.857371 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-ae9cea74-d969-4648-8f9e-b2a524a043eb tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] [instance: daffe717-7636-45e8-813d-8b2a6075c61e] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:49.864830 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ae9cea74-d969-4648-8f9e-b2a524a043eb tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:49.865295 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ae9cea74-d969-4648-8f9e-b2a524a043eb tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:49.866091 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ae9cea74-d969-4648-8f9e-b2a524a043eb tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:49.866615 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ae9cea74-d969-4648-8f9e-b2a524a043eb tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:49.914616 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-d9c4dee4-caae-4ff5-8e9e-8e6d77239634 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:49.923673 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-d9c4dee4-caae-4ff5-8e9e-8e6d77239634 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1723 microversion: 2.1 time: 0.228244 May 27 03:44:49.933620 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 376/708] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:44:49 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1723 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:50.068689 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-ae9cea74-d969-4648-8f9e-b2a524a043eb tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf67cc7398a4e1cb6f565ebe2241e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df96baa86bb4c51b3b8bece28e3e23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:50.076987 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-ae9cea74-d969-4648-8f9e-b2a524a043eb tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] 10.222.0.25 "GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e" status: 200 len: 1357 microversion: 2.1 time: 0.223862 May 27 03:44:50.077579 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 333/709] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:44:49 2021] GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e => generated 1357 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:44:50.133900 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-6ed83aa1-fe29-443a-8024-aa5027024bce tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:50.134678 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-6ed83aa1-fe29-443a-8024-aa5027024bce tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:50.142529 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6ed83aa1-fe29-443a-8024-aa5027024bce tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:50.143083 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6ed83aa1-fe29-443a-8024-aa5027024bce tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:50.143914 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6ed83aa1-fe29-443a-8024-aa5027024bce tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:50.144393 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6ed83aa1-fe29-443a-8024-aa5027024bce tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:50.343931 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-6ed83aa1-fe29-443a-8024-aa5027024bce tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:50.352664 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-6ed83aa1-fe29-443a-8024-aa5027024bce tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:50.354287 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-6ed83aa1-fe29-443a-8024-aa5027024bce tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:50.355491 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-6ed83aa1-fe29-443a-8024-aa5027024bce tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1723 microversion: 2.20 time: 0.225158 May 27 03:44:50.356327 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 377/710] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:44:50 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1723 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:44:50.942095 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-aa74f6dc-13de-4782-b185-5c4a729a7341 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:50.942992 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-aa74f6dc-13de-4782-b185-5c4a729a7341 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:50.950354 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-aa74f6dc-13de-4782-b185-5c4a729a7341 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:50.950917 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-aa74f6dc-13de-4782-b185-5c4a729a7341 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:50.951797 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-aa74f6dc-13de-4782-b185-5c4a729a7341 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:50.952300 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-aa74f6dc-13de-4782-b185-5c4a729a7341 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:51.093884 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-bcdaa7f4-c50e-4ecf-a8a9-1d91d3103354 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:51.094498 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-bcdaa7f4-c50e-4ecf-a8a9-1d91d3103354 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] [instance: daffe717-7636-45e8-813d-8b2a6075c61e] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:51.102107 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-bcdaa7f4-c50e-4ecf-a8a9-1d91d3103354 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:51.102107 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-bcdaa7f4-c50e-4ecf-a8a9-1d91d3103354 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:51.102797 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-bcdaa7f4-c50e-4ecf-a8a9-1d91d3103354 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:51.103263 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-bcdaa7f4-c50e-4ecf-a8a9-1d91d3103354 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:51.152453 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-aa74f6dc-13de-4782-b185-5c4a729a7341 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:51.162759 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-aa74f6dc-13de-4782-b185-5c4a729a7341 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1723 microversion: 2.1 time: 0.225559 May 27 03:44:51.163346 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 334/711] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:44:50 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1723 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:51.306175 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-bcdaa7f4-c50e-4ecf-a8a9-1d91d3103354 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf67cc7398a4e1cb6f565ebe2241e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df96baa86bb4c51b3b8bece28e3e23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:51.314296 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-bcdaa7f4-c50e-4ecf-a8a9-1d91d3103354 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] 10.222.0.25 "GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e" status: 200 len: 1357 microversion: 2.1 time: 0.224204 May 27 03:44:51.314869 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 378/712] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:44:51 2021] GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e => generated 1357 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:44:51.373778 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-fec16ffd-6d75-49ef-8eba-7069f872ec15 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:51.374394 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-fec16ffd-6d75-49ef-8eba-7069f872ec15 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:51.381567 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-fec16ffd-6d75-49ef-8eba-7069f872ec15 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:51.382220 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-fec16ffd-6d75-49ef-8eba-7069f872ec15 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:51.383028 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-fec16ffd-6d75-49ef-8eba-7069f872ec15 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:51.383466 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-fec16ffd-6d75-49ef-8eba-7069f872ec15 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:51.581512 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-fec16ffd-6d75-49ef-8eba-7069f872ec15 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:51.590149 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-fec16ffd-6d75-49ef-8eba-7069f872ec15 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:51.591681 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-fec16ffd-6d75-49ef-8eba-7069f872ec15 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:51.592842 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-fec16ffd-6d75-49ef-8eba-7069f872ec15 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1723 microversion: 2.20 time: 0.222894 May 27 03:44:51.593412 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 335/713] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:44:51 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1723 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:44:52.181395 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-428f1f86-43e9-42d9-8a5d-2b7adb6ab249 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:52.181956 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-428f1f86-43e9-42d9-8a5d-2b7adb6ab249 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:52.189424 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-428f1f86-43e9-42d9-8a5d-2b7adb6ab249 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:52.189873 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-428f1f86-43e9-42d9-8a5d-2b7adb6ab249 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:52.190635 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-428f1f86-43e9-42d9-8a5d-2b7adb6ab249 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:52.191067 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-428f1f86-43e9-42d9-8a5d-2b7adb6ab249 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:52.331398 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-dfe51a26-515e-4b27-ba22-104fb84921c9 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:52.332004 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-dfe51a26-515e-4b27-ba22-104fb84921c9 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] [instance: daffe717-7636-45e8-813d-8b2a6075c61e] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:52.339589 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-dfe51a26-515e-4b27-ba22-104fb84921c9 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:52.340052 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-dfe51a26-515e-4b27-ba22-104fb84921c9 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:52.340865 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-dfe51a26-515e-4b27-ba22-104fb84921c9 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:52.341313 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-dfe51a26-515e-4b27-ba22-104fb84921c9 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:52.387967 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-428f1f86-43e9-42d9-8a5d-2b7adb6ab249 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:52.397276 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-428f1f86-43e9-42d9-8a5d-2b7adb6ab249 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1723 microversion: 2.1 time: 0.219631 May 27 03:44:52.408357 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 379/714] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:44:52 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1723 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:52.610164 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-01e5a9ec-4e7a-4820-a127-224adb8a1f47 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:52.610783 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-01e5a9ec-4e7a-4820-a127-224adb8a1f47 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:52.618196 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-01e5a9ec-4e7a-4820-a127-224adb8a1f47 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:52.618867 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-01e5a9ec-4e7a-4820-a127-224adb8a1f47 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:52.619647 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-01e5a9ec-4e7a-4820-a127-224adb8a1f47 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:52.620083 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-01e5a9ec-4e7a-4820-a127-224adb8a1f47 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:52.774464 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-dfe51a26-515e-4b27-ba22-104fb84921c9 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf67cc7398a4e1cb6f565ebe2241e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df96baa86bb4c51b3b8bece28e3e23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:52.783893 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-dfe51a26-515e-4b27-ba22-104fb84921c9 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] 10.222.0.25 "GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e" status: 200 len: 1357 microversion: 2.1 time: 0.456714 May 27 03:44:52.785852 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 336/715] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:44:52 2021] GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e => generated 1357 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:52.845404 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-01e5a9ec-4e7a-4820-a127-224adb8a1f47 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:52.854415 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-01e5a9ec-4e7a-4820-a127-224adb8a1f47 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:52.855956 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-01e5a9ec-4e7a-4820-a127-224adb8a1f47 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:52.857133 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-01e5a9ec-4e7a-4820-a127-224adb8a1f47 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1723 microversion: 2.20 time: 0.251058 May 27 03:44:52.857865 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 380/716] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:44:52 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1723 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:44:53.415526 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-2eb9f333-1a8b-4d90-a9b5-8f36eb8257ce tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:53.416138 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-2eb9f333-1a8b-4d90-a9b5-8f36eb8257ce tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:53.424015 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2eb9f333-1a8b-4d90-a9b5-8f36eb8257ce tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:53.424498 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2eb9f333-1a8b-4d90-a9b5-8f36eb8257ce tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:53.425271 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2eb9f333-1a8b-4d90-a9b5-8f36eb8257ce tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:53.425703 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2eb9f333-1a8b-4d90-a9b5-8f36eb8257ce tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:53.773530 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-2eb9f333-1a8b-4d90-a9b5-8f36eb8257ce tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:53.783322 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-2eb9f333-1a8b-4d90-a9b5-8f36eb8257ce tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1723 microversion: 2.1 time: 0.371699 May 27 03:44:53.784071 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 337/717] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:44:53 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1723 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:53.805961 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-dbef870d-09de-4030-9090-a2ed02f6a6e0 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:53.805961 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-dbef870d-09de-4030-9090-a2ed02f6a6e0 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] [instance: daffe717-7636-45e8-813d-8b2a6075c61e] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:53.809534 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-dbef870d-09de-4030-9090-a2ed02f6a6e0 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:53.810244 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-dbef870d-09de-4030-9090-a2ed02f6a6e0 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:53.811140 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-dbef870d-09de-4030-9090-a2ed02f6a6e0 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:53.811680 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-dbef870d-09de-4030-9090-a2ed02f6a6e0 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:53.875637 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-0ffc0b1e-dc26-4604-af07-a9310c942bb9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:53.876366 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-0ffc0b1e-dc26-4604-af07-a9310c942bb9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:53.884168 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-0ffc0b1e-dc26-4604-af07-a9310c942bb9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:53.884862 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-0ffc0b1e-dc26-4604-af07-a9310c942bb9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:53.885702 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-0ffc0b1e-dc26-4604-af07-a9310c942bb9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:53.886382 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-0ffc0b1e-dc26-4604-af07-a9310c942bb9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:54.024562 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-dbef870d-09de-4030-9090-a2ed02f6a6e0 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf67cc7398a4e1cb6f565ebe2241e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df96baa86bb4c51b3b8bece28e3e23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:54.035271 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-dbef870d-09de-4030-9090-a2ed02f6a6e0 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] 10.222.0.25 "GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e" status: 200 len: 1357 microversion: 2.1 time: 0.237255 May 27 03:44:54.035690 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 381/718] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:44:53 2021] GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e => generated 1357 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:54.102804 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-0ffc0b1e-dc26-4604-af07-a9310c942bb9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:54.111565 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-0ffc0b1e-dc26-4604-af07-a9310c942bb9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:54.113116 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-0ffc0b1e-dc26-4604-af07-a9310c942bb9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:54.114237 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-0ffc0b1e-dc26-4604-af07-a9310c942bb9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1723 microversion: 2.20 time: 0.242755 May 27 03:44:54.114790 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 338/719] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:44:53 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1723 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:44:54.801895 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-8feb0d7c-f62f-42d3-9dc0-2ea5dd7ada10 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:54.802693 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-8feb0d7c-f62f-42d3-9dc0-2ea5dd7ada10 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:54.810823 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8feb0d7c-f62f-42d3-9dc0-2ea5dd7ada10 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:54.812573 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8feb0d7c-f62f-42d3-9dc0-2ea5dd7ada10 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:54.816873 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8feb0d7c-f62f-42d3-9dc0-2ea5dd7ada10 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:54.816873 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8feb0d7c-f62f-42d3-9dc0-2ea5dd7ada10 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:55.055547 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-8e214c9e-233a-43e4-a677-a803346dc235 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:55.056952 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-8e214c9e-233a-43e4-a677-a803346dc235 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] [instance: daffe717-7636-45e8-813d-8b2a6075c61e] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:55.065941 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8e214c9e-233a-43e4-a677-a803346dc235 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:55.066875 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8e214c9e-233a-43e4-a677-a803346dc235 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:55.068008 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8e214c9e-233a-43e4-a677-a803346dc235 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:55.068924 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8e214c9e-233a-43e4-a677-a803346dc235 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:55.082156 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-8feb0d7c-f62f-42d3-9dc0-2ea5dd7ada10 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:55.093284 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-8feb0d7c-f62f-42d3-9dc0-2ea5dd7ada10 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1723 microversion: 2.1 time: 0.295148 May 27 03:44:55.094674 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 382/720] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:44:54 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1723 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:44:55.133113 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-55eea945-df2b-4d3d-ab33-e8b1571d6ade tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:55.133805 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-55eea945-df2b-4d3d-ab33-e8b1571d6ade tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:55.141865 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-55eea945-df2b-4d3d-ab33-e8b1571d6ade tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:55.142327 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-55eea945-df2b-4d3d-ab33-e8b1571d6ade tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:55.143082 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-55eea945-df2b-4d3d-ab33-e8b1571d6ade tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:55.143614 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-55eea945-df2b-4d3d-ab33-e8b1571d6ade tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:55.276500 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-8e214c9e-233a-43e4-a677-a803346dc235 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf67cc7398a4e1cb6f565ebe2241e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df96baa86bb4c51b3b8bece28e3e23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:55.289847 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-8e214c9e-233a-43e4-a677-a803346dc235 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] 10.222.0.25 "GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e" status: 200 len: 1357 microversion: 2.1 time: 0.234465 May 27 03:44:55.289847 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 339/721] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:44:55 2021] GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e => generated 1357 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:55.376643 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-55eea945-df2b-4d3d-ab33-e8b1571d6ade tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:55.390764 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-55eea945-df2b-4d3d-ab33-e8b1571d6ade tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:55.390764 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-55eea945-df2b-4d3d-ab33-e8b1571d6ade tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:55.390764 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-55eea945-df2b-4d3d-ab33-e8b1571d6ade tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1744 microversion: 2.20 time: 0.258860 May 27 03:44:55.391149 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 383/722] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:44:55 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1744 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:44:56.111321 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-02ed5c88-bbab-4247-95a4-02cbc202f8de tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:56.111943 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-02ed5c88-bbab-4247-95a4-02cbc202f8de tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:56.119376 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-02ed5c88-bbab-4247-95a4-02cbc202f8de tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:56.119856 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-02ed5c88-bbab-4247-95a4-02cbc202f8de tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:56.120659 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-02ed5c88-bbab-4247-95a4-02cbc202f8de tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:56.121105 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-02ed5c88-bbab-4247-95a4-02cbc202f8de tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:56.304667 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-3198574c-499a-48aa-bfdf-84edf6c53c11 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:56.305281 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-3198574c-499a-48aa-bfdf-84edf6c53c11 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] [instance: daffe717-7636-45e8-813d-8b2a6075c61e] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:56.313381 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3198574c-499a-48aa-bfdf-84edf6c53c11 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:56.314001 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3198574c-499a-48aa-bfdf-84edf6c53c11 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:56.315266 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3198574c-499a-48aa-bfdf-84edf6c53c11 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:56.315707 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3198574c-499a-48aa-bfdf-84edf6c53c11 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:56.317539 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-02ed5c88-bbab-4247-95a4-02cbc202f8de tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:56.326752 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-02ed5c88-bbab-4247-95a4-02cbc202f8de tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1723 microversion: 2.1 time: 0.219570 May 27 03:44:56.327322 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 340/723] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:44:56 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1723 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:56.407580 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-78d816c4-adbe-4590-aeb2-8306e4e5b53d tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:56.408201 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-78d816c4-adbe-4590-aeb2-8306e4e5b53d tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:56.415758 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-78d816c4-adbe-4590-aeb2-8306e4e5b53d tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:56.416216 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-78d816c4-adbe-4590-aeb2-8306e4e5b53d tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:56.417027 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-78d816c4-adbe-4590-aeb2-8306e4e5b53d tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:56.417682 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-78d816c4-adbe-4590-aeb2-8306e4e5b53d tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:56.641139 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-78d816c4-adbe-4590-aeb2-8306e4e5b53d tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:56.650744 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-78d816c4-adbe-4590-aeb2-8306e4e5b53d tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:56.652337 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-78d816c4-adbe-4590-aeb2-8306e4e5b53d tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:56.653529 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-78d816c4-adbe-4590-aeb2-8306e4e5b53d tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1744 microversion: 2.20 time: 0.250343 May 27 03:44:56.654367 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 341/724] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:44:56 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1744 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:44:56.754085 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-3198574c-499a-48aa-bfdf-84edf6c53c11 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf67cc7398a4e1cb6f565ebe2241e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df96baa86bb4c51b3b8bece28e3e23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:56.768120 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-3198574c-499a-48aa-bfdf-84edf6c53c11 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] 10.222.0.25 "GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e" status: 200 len: 1357 microversion: 2.1 time: 0.466744 May 27 03:44:56.778476 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 384/725] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:44:56 2021] GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e => generated 1357 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:57.342870 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-563ec691-adcd-4871-b275-b67e04fdaabd tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:57.343424 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-563ec691-adcd-4871-b275-b67e04fdaabd tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:57.350779 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-563ec691-adcd-4871-b275-b67e04fdaabd tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:57.351231 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-563ec691-adcd-4871-b275-b67e04fdaabd tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:57.352007 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-563ec691-adcd-4871-b275-b67e04fdaabd tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:57.352479 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-563ec691-adcd-4871-b275-b67e04fdaabd tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:57.548474 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-563ec691-adcd-4871-b275-b67e04fdaabd tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:57.557147 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-563ec691-adcd-4871-b275-b67e04fdaabd tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1723 microversion: 2.1 time: 0.217999 May 27 03:44:57.557717 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 342/726] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:44:57 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1723 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:57.672951 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-ed93fc96-29f6-4210-a6f7-729355302e0a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:57.681707 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-ed93fc96-29f6-4210-a6f7-729355302e0a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:57.684942 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ed93fc96-29f6-4210-a6f7-729355302e0a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:57.685393 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ed93fc96-29f6-4210-a6f7-729355302e0a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:57.686169 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ed93fc96-29f6-4210-a6f7-729355302e0a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:57.686604 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ed93fc96-29f6-4210-a6f7-729355302e0a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:57.786291 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-6a8f7355-c3b7-4b2c-aaee-b46052bc7938 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:57.787169 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-6a8f7355-c3b7-4b2c-aaee-b46052bc7938 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] [instance: daffe717-7636-45e8-813d-8b2a6075c61e] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:57.800218 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6a8f7355-c3b7-4b2c-aaee-b46052bc7938 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:57.800903 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6a8f7355-c3b7-4b2c-aaee-b46052bc7938 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:57.801795 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6a8f7355-c3b7-4b2c-aaee-b46052bc7938 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:57.802405 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6a8f7355-c3b7-4b2c-aaee-b46052bc7938 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:57.925467 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-ed93fc96-29f6-4210-a6f7-729355302e0a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:57.935254 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-ed93fc96-29f6-4210-a6f7-729355302e0a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:57.937216 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-ed93fc96-29f6-4210-a6f7-729355302e0a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:57.938298 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-ed93fc96-29f6-4210-a6f7-729355302e0a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1744 microversion: 2.20 time: 0.269817 May 27 03:44:57.939113 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 385/727] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:44:57 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1744 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:44:58.088833 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-6a8f7355-c3b7-4b2c-aaee-b46052bc7938 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf67cc7398a4e1cb6f565ebe2241e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df96baa86bb4c51b3b8bece28e3e23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:58.097584 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-6a8f7355-c3b7-4b2c-aaee-b46052bc7938 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] 10.222.0.25 "GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e" status: 200 len: 1357 microversion: 2.1 time: 0.315483 May 27 03:44:58.098360 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 343/728] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:44:57 2021] GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e => generated 1357 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:44:58.576046 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-e698c57a-dd36-48ad-8a9f-fc7644e80a47 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:58.578621 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-e698c57a-dd36-48ad-8a9f-fc7644e80a47 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:58.591930 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e698c57a-dd36-48ad-8a9f-fc7644e80a47 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:58.592388 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e698c57a-dd36-48ad-8a9f-fc7644e80a47 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:58.593704 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e698c57a-dd36-48ad-8a9f-fc7644e80a47 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:58.594169 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e698c57a-dd36-48ad-8a9f-fc7644e80a47 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:58.797998 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [req-a5a50116-b095-424e-9465-c5c394b74c4f req-7b0408ce-5817-4078-82e4-097f92c67a07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e367eb4b-29c5-4f41-b41d-0da84d751fe2", "name": "network-vif-plugged", "status": "completed", "tag": "396ee32c-72a8-43ea-b35c-f0de6de19d7a"}]} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:44:58.799044 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:44:58.799044 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: warnings.warn(msg) May 27 03:44:58.808094 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-a5a50116-b095-424e-9465-c5c394b74c4f req-7b0408ce-5817-4078-82e4-097f92c67a07 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:58.808575 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-a5a50116-b095-424e-9465-c5c394b74c4f req-7b0408ce-5817-4078-82e4-097f92c67a07 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:58.819049 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-e698c57a-dd36-48ad-8a9f-fc7644e80a47 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:58.830554 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-e698c57a-dd36-48ad-8a9f-fc7644e80a47 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1723 microversion: 2.1 time: 0.260355 May 27 03:44:58.834549 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 386/729] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:44:58 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1723 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:44:58.835042 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.compute.server_external_events [req-a5a50116-b095-424e-9465-c5c394b74c4f req-7b0408ce-5817-4078-82e4-097f92c67a07 service nova] Creating event network-vif-plugged:396ee32c-72a8-43ea-b35c-f0de6de19d7a for instance e367eb4b-29c5-4f41-b41d-0da84d751fe2 on hv-cinder-79326 May 27 03:44:58.840526 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [req-a5a50116-b095-424e-9465-c5c394b74c4f req-7b0408ce-5817-4078-82e4-097f92c67a07 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051065 May 27 03:44:58.841995 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 344/730] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:44:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:44:58.957165 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-f3dc1dbc-8007-406b-9877-833a8ce2c25e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:58.957806 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-f3dc1dbc-8007-406b-9877-833a8ce2c25e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:58.965341 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f3dc1dbc-8007-406b-9877-833a8ce2c25e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:58.965789 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f3dc1dbc-8007-406b-9877-833a8ce2c25e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:58.966568 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f3dc1dbc-8007-406b-9877-833a8ce2c25e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:58.967003 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f3dc1dbc-8007-406b-9877-833a8ce2c25e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:59.114603 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-ebd989ee-407e-4926-965d-7b23a0bd03ef tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:59.115247 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-ebd989ee-407e-4926-965d-7b23a0bd03ef tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] [instance: daffe717-7636-45e8-813d-8b2a6075c61e] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:59.122966 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ebd989ee-407e-4926-965d-7b23a0bd03ef tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:59.124235 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ebd989ee-407e-4926-965d-7b23a0bd03ef tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:59.130051 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ebd989ee-407e-4926-965d-7b23a0bd03ef tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:59.130530 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ebd989ee-407e-4926-965d-7b23a0bd03ef tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:59.178310 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-f3dc1dbc-8007-406b-9877-833a8ce2c25e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:59.188671 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-f3dc1dbc-8007-406b-9877-833a8ce2c25e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:59.190201 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-f3dc1dbc-8007-406b-9877-833a8ce2c25e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:59.191523 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-f3dc1dbc-8007-406b-9877-833a8ce2c25e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1744 microversion: 2.20 time: 0.238399 May 27 03:44:59.192079 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 387/731] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:44:58 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1744 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:44:59.340576 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-ebd989ee-407e-4926-965d-7b23a0bd03ef tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf67cc7398a4e1cb6f565ebe2241e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df96baa86bb4c51b3b8bece28e3e23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:44:59.352134 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-ebd989ee-407e-4926-965d-7b23a0bd03ef tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] 10.222.0.25 "GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e" status: 200 len: 1357 microversion: 2.1 time: 0.241369 May 27 03:44:59.352759 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 345/732] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:44:59 2021] GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e => generated 1357 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:44:59.851079 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-4564b7fd-3fde-49e7-9ec1-888893ac80e1 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:44:59.851702 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-4564b7fd-3fde-49e7-9ec1-888893ac80e1 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:44:59.859012 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4564b7fd-3fde-49e7-9ec1-888893ac80e1 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:59.859471 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4564b7fd-3fde-49e7-9ec1-888893ac80e1 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:44:59.860251 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4564b7fd-3fde-49e7-9ec1-888893ac80e1 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:44:59.860733 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4564b7fd-3fde-49e7-9ec1-888893ac80e1 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:00.067874 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-4564b7fd-3fde-49e7-9ec1-888893ac80e1 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:00.076622 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-4564b7fd-3fde-49e7-9ec1-888893ac80e1 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1723 microversion: 2.1 time: 0.229359 May 27 03:45:00.077386 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 388/733] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:44:59 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1723 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:45:00.212870 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-4fe28a3c-b448-41ff-bdc9-ad2d6e9c0267 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:00.213521 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-4fe28a3c-b448-41ff-bdc9-ad2d6e9c0267 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:00.223308 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-4fe28a3c-b448-41ff-bdc9-ad2d6e9c0267 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:00.223308 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-4fe28a3c-b448-41ff-bdc9-ad2d6e9c0267 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:00.223308 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-4fe28a3c-b448-41ff-bdc9-ad2d6e9c0267 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:00.223308 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-4fe28a3c-b448-41ff-bdc9-ad2d6e9c0267 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:00.370071 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-e9222d1d-cfc1-4ed8-a07d-c3ced7eebe71 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:00.370697 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-e9222d1d-cfc1-4ed8-a07d-c3ced7eebe71 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] [instance: daffe717-7636-45e8-813d-8b2a6075c61e] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:00.389983 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e9222d1d-cfc1-4ed8-a07d-c3ced7eebe71 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:00.390584 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e9222d1d-cfc1-4ed8-a07d-c3ced7eebe71 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:00.391398 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e9222d1d-cfc1-4ed8-a07d-c3ced7eebe71 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:00.391834 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e9222d1d-cfc1-4ed8-a07d-c3ced7eebe71 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:00.437697 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-4fe28a3c-b448-41ff-bdc9-ad2d6e9c0267 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:00.448975 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-4fe28a3c-b448-41ff-bdc9-ad2d6e9c0267 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:00.451763 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-4fe28a3c-b448-41ff-bdc9-ad2d6e9c0267 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:00.458684 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-4fe28a3c-b448-41ff-bdc9-ad2d6e9c0267 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1744 microversion: 2.20 time: 0.244474 May 27 03:45:00.458684 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 346/734] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:45:00 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1744 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:45:00.630825 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-e9222d1d-cfc1-4ed8-a07d-c3ced7eebe71 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf67cc7398a4e1cb6f565ebe2241e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df96baa86bb4c51b3b8bece28e3e23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:00.639082 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-e9222d1d-cfc1-4ed8-a07d-c3ced7eebe71 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] 10.222.0.25 "GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e" status: 200 len: 1357 microversion: 2.1 time: 0.273498 May 27 03:45:00.639652 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 389/735] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:45:00 2021] GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e => generated 1357 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:45:00.861091 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [req-12ca120e-9b94-4a17-9090-6cdc53e71522 req-bce342b5-fdd6-4997-a882-008b3c12d4a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "daffe717-7636-45e8-813d-8b2a6075c61e", "name": "network-vif-plugged", "status": "completed", "tag": "2beacebc-a476-4d0c-ad0f-528ef5b957c8"}]} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:45:00.863016 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:45:00.863016 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: warnings.warn(msg) May 27 03:45:00.872367 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-12ca120e-9b94-4a17-9090-6cdc53e71522 req-bce342b5-fdd6-4997-a882-008b3c12d4a0 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:00.872942 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-12ca120e-9b94-4a17-9090-6cdc53e71522 req-bce342b5-fdd6-4997-a882-008b3c12d4a0 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:00.896192 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.compute.server_external_events [req-12ca120e-9b94-4a17-9090-6cdc53e71522 req-bce342b5-fdd6-4997-a882-008b3c12d4a0 service nova] Creating event network-vif-plugged:2beacebc-a476-4d0c-ad0f-528ef5b957c8 for instance daffe717-7636-45e8-813d-8b2a6075c61e on hv-cinder-79326 May 27 03:45:00.901661 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [req-12ca120e-9b94-4a17-9090-6cdc53e71522 req-bce342b5-fdd6-4997-a882-008b3c12d4a0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048074 May 27 03:45:00.902528 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 347/736] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:45:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:45:01.094759 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-fc94dda8-7e6f-4c33-a455-5dc85faf3a1a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:01.095409 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-fc94dda8-7e6f-4c33-a455-5dc85faf3a1a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:01.102676 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-fc94dda8-7e6f-4c33-a455-5dc85faf3a1a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:01.103129 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-fc94dda8-7e6f-4c33-a455-5dc85faf3a1a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:01.103942 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-fc94dda8-7e6f-4c33-a455-5dc85faf3a1a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:01.104370 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-fc94dda8-7e6f-4c33-a455-5dc85faf3a1a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:01.409568 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-fc94dda8-7e6f-4c33-a455-5dc85faf3a1a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:01.420350 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-fc94dda8-7e6f-4c33-a455-5dc85faf3a1a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1723 microversion: 2.1 time: 0.329869 May 27 03:45:01.421318 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 390/737] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:45:01 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1723 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:45:01.473596 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-fad06143-246d-4fb4-8782-1973ca11e41e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:01.475128 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-fad06143-246d-4fb4-8782-1973ca11e41e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:01.483458 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-fad06143-246d-4fb4-8782-1973ca11e41e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:01.483940 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-fad06143-246d-4fb4-8782-1973ca11e41e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:01.485006 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-fad06143-246d-4fb4-8782-1973ca11e41e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:01.485599 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-fad06143-246d-4fb4-8782-1973ca11e41e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:01.655111 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-cc2f1139-aeb3-4c4b-a167-48d345ac7a65 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:01.656058 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-cc2f1139-aeb3-4c4b-a167-48d345ac7a65 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] [instance: daffe717-7636-45e8-813d-8b2a6075c61e] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:01.673021 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-cc2f1139-aeb3-4c4b-a167-48d345ac7a65 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:01.676925 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-cc2f1139-aeb3-4c4b-a167-48d345ac7a65 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:01.677882 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-cc2f1139-aeb3-4c4b-a167-48d345ac7a65 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:01.678455 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-cc2f1139-aeb3-4c4b-a167-48d345ac7a65 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:01.723451 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-fad06143-246d-4fb4-8782-1973ca11e41e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:01.732794 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-fad06143-246d-4fb4-8782-1973ca11e41e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:01.734600 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-fad06143-246d-4fb4-8782-1973ca11e41e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:01.735926 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-fad06143-246d-4fb4-8782-1973ca11e41e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1739 microversion: 2.20 time: 0.266806 May 27 03:45:01.750426 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 348/738] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:45:01 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1739 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:45:01.987330 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-cc2f1139-aeb3-4c4b-a167-48d345ac7a65 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf67cc7398a4e1cb6f565ebe2241e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df96baa86bb4c51b3b8bece28e3e23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:01.996050 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-cc2f1139-aeb3-4c4b-a167-48d345ac7a65 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] 10.222.0.25 "GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e" status: 200 len: 1357 microversion: 2.1 time: 0.344676 May 27 03:45:01.996699 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 391/739] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:45:01 2021] GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e => generated 1357 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:45:02.447510 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-d4188281-26b9-46ab-bb6b-b2ea60b9b250 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:02.453000 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-d4188281-26b9-46ab-bb6b-b2ea60b9b250 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:02.464361 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d4188281-26b9-46ab-bb6b-b2ea60b9b250 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:02.469322 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d4188281-26b9-46ab-bb6b-b2ea60b9b250 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:02.469322 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d4188281-26b9-46ab-bb6b-b2ea60b9b250 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:02.469322 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d4188281-26b9-46ab-bb6b-b2ea60b9b250 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:02.732132 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-d4188281-26b9-46ab-bb6b-b2ea60b9b250 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:02.741770 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-d4188281-26b9-46ab-bb6b-b2ea60b9b250 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1723 microversion: 2.1 time: 0.306551 May 27 03:45:02.742664 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 349/740] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:45:02 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1723 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:45:02.758360 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-1c5c01fd-d918-4f27-ad8b-e56fa6f6b458 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:02.759135 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-1c5c01fd-d918-4f27-ad8b-e56fa6f6b458 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:02.767515 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1c5c01fd-d918-4f27-ad8b-e56fa6f6b458 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:02.768184 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1c5c01fd-d918-4f27-ad8b-e56fa6f6b458 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:02.769080 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1c5c01fd-d918-4f27-ad8b-e56fa6f6b458 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:02.769591 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1c5c01fd-d918-4f27-ad8b-e56fa6f6b458 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:03.013014 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-9d51000f-ddde-40b5-ae29-96e02cbc3e62 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:03.015124 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-9d51000f-ddde-40b5-ae29-96e02cbc3e62 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] [instance: daffe717-7636-45e8-813d-8b2a6075c61e] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:03.024351 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-9d51000f-ddde-40b5-ae29-96e02cbc3e62 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:03.025085 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-9d51000f-ddde-40b5-ae29-96e02cbc3e62 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:03.025978 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-9d51000f-ddde-40b5-ae29-96e02cbc3e62 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:03.026718 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-9d51000f-ddde-40b5-ae29-96e02cbc3e62 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:03.096426 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-1c5c01fd-d918-4f27-ad8b-e56fa6f6b458 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:03.106160 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-1c5c01fd-d918-4f27-ad8b-e56fa6f6b458 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:03.108857 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-1c5c01fd-d918-4f27-ad8b-e56fa6f6b458 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:03.110150 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-1c5c01fd-d918-4f27-ad8b-e56fa6f6b458 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1739 microversion: 2.20 time: 0.355919 May 27 03:45:03.121171 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 392/741] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:45:02 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1739 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:45:03.276154 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-9d51000f-ddde-40b5-ae29-96e02cbc3e62 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf67cc7398a4e1cb6f565ebe2241e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df96baa86bb4c51b3b8bece28e3e23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:03.288096 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-9d51000f-ddde-40b5-ae29-96e02cbc3e62 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] 10.222.0.25 "GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e" status: 200 len: 1547 microversion: 2.1 time: 0.278972 May 27 03:45:03.289194 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 350/742] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:45:03 2021] GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e => generated 1547 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:45:03.304465 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-39e20663-8680-4ddf-889c-2f004852c703 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:03.305202 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-39e20663-8680-4ddf-889c-2f004852c703 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] [instance: daffe717-7636-45e8-813d-8b2a6075c61e] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:03.314715 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-39e20663-8680-4ddf-889c-2f004852c703 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:03.315482 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-39e20663-8680-4ddf-889c-2f004852c703 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:03.316522 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-39e20663-8680-4ddf-889c-2f004852c703 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:03.317147 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-39e20663-8680-4ddf-889c-2f004852c703 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:03.564748 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-39e20663-8680-4ddf-889c-2f004852c703 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf67cc7398a4e1cb6f565ebe2241e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df96baa86bb4c51b3b8bece28e3e23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:03.574920 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-39e20663-8680-4ddf-889c-2f004852c703 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] 10.222.0.25 "GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e" status: 200 len: 1547 microversion: 2.1 time: 0.273891 May 27 03:45:03.575742 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 393/743] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:45:03 2021] GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e => generated 1547 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:45:03.593905 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-98594468-2998-46fd-84a9-12c054447306 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:03.600558 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:45:03.600558 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: warnings.warn(msg) May 27 03:45:03.604754 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-98594468-2998-46fd-84a9-12c054447306 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'adf67cc7398a4e1cb6f565ebe2241e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df96baa86bb4c51b3b8bece28e3e23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:03.606073 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-98594468-2998-46fd-84a9-12c054447306 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Searching by: {'deleted': False, 'project_id': '0df96baa86bb4c51b3b8bece28e3e23a'} {{(pid=113021) get_all /opt/stack/nova/nova/compute/api.py:2832}} May 27 03:45:03.612820 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-98594468-2998-46fd-84a9-12c054447306 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:03.613359 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-98594468-2998-46fd-84a9-12c054447306 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:03.614226 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-98594468-2998-46fd-84a9-12c054447306 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:03.614729 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-98594468-2998-46fd-84a9-12c054447306 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:03.758919 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-a8bd78c9-0495-4dfd-9592-d49d02eddde7 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:03.759621 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-a8bd78c9-0495-4dfd-9592-d49d02eddde7 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:03.778544 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a8bd78c9-0495-4dfd-9592-d49d02eddde7 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:03.778718 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a8bd78c9-0495-4dfd-9592-d49d02eddde7 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:03.779663 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a8bd78c9-0495-4dfd-9592-d49d02eddde7 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:03.780212 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a8bd78c9-0495-4dfd-9592-d49d02eddde7 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:03.963470 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.multi_cell_list [None req-98594468-2998-46fd-84a9-12c054447306 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=113021) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} May 27 03:45:04.109121 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-98594468-2998-46fd-84a9-12c054447306 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.521729 May 27 03:45:04.112453 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 351/744] 10.222.0.25 () {58 vars in 1125 bytes} [Thu May 27 03:45:03 2021] GET /compute/v2.1/servers => generated 342 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:45:04.121678 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-3427e984-4337-41c6-9493-15fb8600be27 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:04.122777 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-3427e984-4337-41c6-9493-15fb8600be27 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] [instance: daffe717-7636-45e8-813d-8b2a6075c61e] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:04.136196 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-3427e984-4337-41c6-9493-15fb8600be27 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:04.137015 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-3427e984-4337-41c6-9493-15fb8600be27 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:04.137998 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-3427e984-4337-41c6-9493-15fb8600be27 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:04.144249 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-3427e984-4337-41c6-9493-15fb8600be27 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:04.170533 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-a8bd78c9-0495-4dfd-9592-d49d02eddde7 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:04.180393 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-a8bd78c9-0495-4dfd-9592-d49d02eddde7 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1723 microversion: 2.1 time: 0.425553 May 27 03:45:04.184951 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 394/745] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:45:03 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1723 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:45:04.194760 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-496cc760-ac94-4d82-b9bc-9456a0b99064 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:04.195395 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-496cc760-ac94-4d82-b9bc-9456a0b99064 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:04.214921 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-496cc760-ac94-4d82-b9bc-9456a0b99064 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:04.215674 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-496cc760-ac94-4d82-b9bc-9456a0b99064 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:04.216498 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-496cc760-ac94-4d82-b9bc-9456a0b99064 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:04.216948 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-496cc760-ac94-4d82-b9bc-9456a0b99064 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:04.648871 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-496cc760-ac94-4d82-b9bc-9456a0b99064 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:04.649277 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-3427e984-4337-41c6-9493-15fb8600be27 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf67cc7398a4e1cb6f565ebe2241e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df96baa86bb4c51b3b8bece28e3e23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:04.649277 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-3427e984-4337-41c6-9493-15fb8600be27 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] 10.222.0.25 "GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e" status: 200 len: 1547 microversion: 2.1 time: 0.458036 May 27 03:45:04.649838 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-496cc760-ac94-4d82-b9bc-9456a0b99064 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:04.650113 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 352/746] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:45:04 2021] GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e => generated 1547 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:45:04.650308 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-496cc760-ac94-4d82-b9bc-9456a0b99064 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:04.650308 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-496cc760-ac94-4d82-b9bc-9456a0b99064 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1739 microversion: 2.20 time: 0.391324 May 27 03:45:04.650308 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 395/747] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:45:04 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1739 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:45:05.202833 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-8425ea1b-9669-4f4d-887d-0ef8c04e4072 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:05.206365 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-8425ea1b-9669-4f4d-887d-0ef8c04e4072 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:05.224579 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8425ea1b-9669-4f4d-887d-0ef8c04e4072 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:05.225223 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8425ea1b-9669-4f4d-887d-0ef8c04e4072 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:05.226267 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8425ea1b-9669-4f4d-887d-0ef8c04e4072 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:05.226715 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8425ea1b-9669-4f4d-887d-0ef8c04e4072 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:05.467705 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-8425ea1b-9669-4f4d-887d-0ef8c04e4072 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:05.477436 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-8425ea1b-9669-4f4d-887d-0ef8c04e4072 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1723 microversion: 2.1 time: 0.279088 May 27 03:45:05.477967 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 353/748] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:45:05 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1723 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:45:05.655238 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-baebfe88-538f-406e-951b-9772c470a57e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:05.655238 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-baebfe88-538f-406e-951b-9772c470a57e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:05.674708 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-baebfe88-538f-406e-951b-9772c470a57e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:05.675349 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-baebfe88-538f-406e-951b-9772c470a57e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:05.677460 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-baebfe88-538f-406e-951b-9772c470a57e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:05.678720 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-baebfe88-538f-406e-951b-9772c470a57e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:06.026482 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-baebfe88-538f-406e-951b-9772c470a57e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:06.054576 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-baebfe88-538f-406e-951b-9772c470a57e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:06.056724 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-baebfe88-538f-406e-951b-9772c470a57e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:06.058378 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-baebfe88-538f-406e-951b-9772c470a57e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1739 microversion: 2.20 time: 0.411222 May 27 03:45:06.059481 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 396/749] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:45:05 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1739 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:45:06.497421 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-d973d2d7-a88d-4711-bce8-ef8a43bef2fa tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:06.498704 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-d973d2d7-a88d-4711-bce8-ef8a43bef2fa tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:06.513809 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d973d2d7-a88d-4711-bce8-ef8a43bef2fa tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:06.514631 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d973d2d7-a88d-4711-bce8-ef8a43bef2fa tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:06.515785 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d973d2d7-a88d-4711-bce8-ef8a43bef2fa tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:06.516775 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d973d2d7-a88d-4711-bce8-ef8a43bef2fa tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:06.769986 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-d973d2d7-a88d-4711-bce8-ef8a43bef2fa tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:06.779890 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-d973d2d7-a88d-4711-bce8-ef8a43bef2fa tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1723 microversion: 2.1 time: 0.287384 May 27 03:45:06.794799 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 354/750] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:45:06 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1723 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:45:07.084500 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-e32fb9a3-fa0f-4217-beae-de734aa4a5e4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:07.085114 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-e32fb9a3-fa0f-4217-beae-de734aa4a5e4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:07.127774 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e32fb9a3-fa0f-4217-beae-de734aa4a5e4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:07.128996 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e32fb9a3-fa0f-4217-beae-de734aa4a5e4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:07.129893 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e32fb9a3-fa0f-4217-beae-de734aa4a5e4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:07.130343 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e32fb9a3-fa0f-4217-beae-de734aa4a5e4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:07.386132 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-e32fb9a3-fa0f-4217-beae-de734aa4a5e4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:07.399607 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-e32fb9a3-fa0f-4217-beae-de734aa4a5e4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:07.405031 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-e32fb9a3-fa0f-4217-beae-de734aa4a5e4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:07.406324 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-e32fb9a3-fa0f-4217-beae-de734aa4a5e4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1739 microversion: 2.20 time: 0.331190 May 27 03:45:07.407771 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 397/751] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:45:07 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1739 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:45:07.679969 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-60c64311-a752-4440-8bc3-ef6d783f74cc tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "716cd419-03d5-45e0-90da-4d9ec3b118a3"}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:45:07.682258 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-60c64311-a752-4440-8bc3-ef6d783f74cc tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] [instance: daffe717-7636-45e8-813d-8b2a6075c61e] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:07.692749 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-60c64311-a752-4440-8bc3-ef6d783f74cc tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:07.693962 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-60c64311-a752-4440-8bc3-ef6d783f74cc tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:07.694987 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-60c64311-a752-4440-8bc3-ef6d783f74cc tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:07.695651 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-60c64311-a752-4440-8bc3-ef6d783f74cc tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:07.798251 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-ae942498-a7f6-4fcc-b17a-b874b18b2c73 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:07.799237 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-ae942498-a7f6-4fcc-b17a-b874b18b2c73 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:07.812215 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ae942498-a7f6-4fcc-b17a-b874b18b2c73 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:07.815959 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ae942498-a7f6-4fcc-b17a-b874b18b2c73 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:07.817338 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ae942498-a7f6-4fcc-b17a-b874b18b2c73 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:07.818012 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ae942498-a7f6-4fcc-b17a-b874b18b2c73 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:08.256193 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-ae942498-a7f6-4fcc-b17a-b874b18b2c73 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:08.275169 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-ae942498-a7f6-4fcc-b17a-b874b18b2c73 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1723 microversion: 2.1 time: 0.470698 May 27 03:45:08.275169 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 398/752] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:45:07 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1723 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:45:08.446908 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-6cc66db4-78ac-4fe8-9cae-02ef1e9f391f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:08.446908 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-6cc66db4-78ac-4fe8-9cae-02ef1e9f391f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:08.476287 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6cc66db4-78ac-4fe8-9cae-02ef1e9f391f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:08.478451 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6cc66db4-78ac-4fe8-9cae-02ef1e9f391f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:08.480292 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6cc66db4-78ac-4fe8-9cae-02ef1e9f391f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:08.481600 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6cc66db4-78ac-4fe8-9cae-02ef1e9f391f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:08.766703 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-6cc66db4-78ac-4fe8-9cae-02ef1e9f391f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:08.775247 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-6cc66db4-78ac-4fe8-9cae-02ef1e9f391f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:08.776792 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-6cc66db4-78ac-4fe8-9cae-02ef1e9f391f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:08.777912 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-6cc66db4-78ac-4fe8-9cae-02ef1e9f391f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1739 microversion: 2.20 time: 0.345749 May 27 03:45:08.778651 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 399/753] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:45:08 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1739 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:45:09.204590 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-60c64311-a752-4440-8bc3-ef6d783f74cc tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] 10.222.0.25 "POST /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.527898 May 27 03:45:09.206085 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 355/754] 10.222.0.25 () {60 vars in 1323 bytes} [Thu May 27 03:45:07 2021] POST /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e/os-volume_attachments => generated 194 bytes in 1531 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:45:09.282759 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-25be0af0-8742-4060-b7bc-2d7c9616c607 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:09.283334 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-25be0af0-8742-4060-b7bc-2d7c9616c607 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:09.292689 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-25be0af0-8742-4060-b7bc-2d7c9616c607 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:09.302366 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-25be0af0-8742-4060-b7bc-2d7c9616c607 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:09.302366 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-25be0af0-8742-4060-b7bc-2d7c9616c607 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:09.302366 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-25be0af0-8742-4060-b7bc-2d7c9616c607 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:09.721006 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-25be0af0-8742-4060-b7bc-2d7c9616c607 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:09.731282 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-25be0af0-8742-4060-b7bc-2d7c9616c607 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1723 microversion: 2.1 time: 0.452571 May 27 03:45:09.732209 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 400/755] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:45:09 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1723 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:45:09.797092 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-1f965aa7-3bdd-484c-8cb7-5117c02a6bdd tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:09.797717 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-1f965aa7-3bdd-484c-8cb7-5117c02a6bdd tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:09.806795 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1f965aa7-3bdd-484c-8cb7-5117c02a6bdd tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:09.807260 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1f965aa7-3bdd-484c-8cb7-5117c02a6bdd tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:09.808044 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1f965aa7-3bdd-484c-8cb7-5117c02a6bdd tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:09.808517 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1f965aa7-3bdd-484c-8cb7-5117c02a6bdd tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:10.072644 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-1f965aa7-3bdd-484c-8cb7-5117c02a6bdd tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:10.082763 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-1f965aa7-3bdd-484c-8cb7-5117c02a6bdd tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:10.084490 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-1f965aa7-3bdd-484c-8cb7-5117c02a6bdd tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:10.085827 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-1f965aa7-3bdd-484c-8cb7-5117c02a6bdd tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1739 microversion: 2.20 time: 0.293259 May 27 03:45:10.086370 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 356/756] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:45:09 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1739 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:45:10.748259 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-3c9833d5-5d2f-4963-848c-51b6ca0f9e05 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:10.749158 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-3c9833d5-5d2f-4963-848c-51b6ca0f9e05 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:10.762698 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3c9833d5-5d2f-4963-848c-51b6ca0f9e05 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:10.768797 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3c9833d5-5d2f-4963-848c-51b6ca0f9e05 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:10.786234 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3c9833d5-5d2f-4963-848c-51b6ca0f9e05 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:10.787806 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3c9833d5-5d2f-4963-848c-51b6ca0f9e05 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:11.100024 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-3c9833d5-5d2f-4963-848c-51b6ca0f9e05 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:11.104006 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-009616e9-d1eb-4d4a-87eb-b099bbe467e0 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:11.106176 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-009616e9-d1eb-4d4a-87eb-b099bbe467e0 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:11.112885 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-3c9833d5-5d2f-4963-848c-51b6ca0f9e05 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1723 microversion: 2.1 time: 0.367999 May 27 03:45:11.114030 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 401/757] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:45:10 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1723 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:45:11.120491 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-009616e9-d1eb-4d4a-87eb-b099bbe467e0 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:11.120977 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-009616e9-d1eb-4d4a-87eb-b099bbe467e0 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:11.121768 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-009616e9-d1eb-4d4a-87eb-b099bbe467e0 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:11.122413 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-009616e9-d1eb-4d4a-87eb-b099bbe467e0 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:11.365742 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-009616e9-d1eb-4d4a-87eb-b099bbe467e0 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:11.379036 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-009616e9-d1eb-4d4a-87eb-b099bbe467e0 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:11.380585 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-009616e9-d1eb-4d4a-87eb-b099bbe467e0 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:11.381875 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-009616e9-d1eb-4d4a-87eb-b099bbe467e0 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1739 microversion: 2.20 time: 0.282594 May 27 03:45:11.382585 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 357/758] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:45:11 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1739 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:45:12.129794 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-b24c2ed4-15fe-40e6-8d10-1a78500d0f21 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:12.130410 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-b24c2ed4-15fe-40e6-8d10-1a78500d0f21 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:12.148373 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b24c2ed4-15fe-40e6-8d10-1a78500d0f21 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:12.149144 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b24c2ed4-15fe-40e6-8d10-1a78500d0f21 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:12.150121 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b24c2ed4-15fe-40e6-8d10-1a78500d0f21 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:12.150721 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b24c2ed4-15fe-40e6-8d10-1a78500d0f21 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:12.443035 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-41f87c3d-231f-4bc3-947c-a615be185a1e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:12.443035 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-41f87c3d-231f-4bc3-947c-a615be185a1e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:12.443035 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-41f87c3d-231f-4bc3-947c-a615be185a1e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:12.443035 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-41f87c3d-231f-4bc3-947c-a615be185a1e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:12.443933 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-41f87c3d-231f-4bc3-947c-a615be185a1e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:12.443933 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-41f87c3d-231f-4bc3-947c-a615be185a1e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:12.456493 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-b24c2ed4-15fe-40e6-8d10-1a78500d0f21 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:12.472308 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-b24c2ed4-15fe-40e6-8d10-1a78500d0f21 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1723 microversion: 2.1 time: 0.346371 May 27 03:45:12.473485 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 402/759] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:45:12 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1723 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:45:12.658359 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-41f87c3d-231f-4bc3-947c-a615be185a1e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:12.667345 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-41f87c3d-231f-4bc3-947c-a615be185a1e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:12.668901 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-41f87c3d-231f-4bc3-947c-a615be185a1e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:12.670116 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-41f87c3d-231f-4bc3-947c-a615be185a1e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1739 microversion: 2.20 time: 0.271621 May 27 03:45:12.670593 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 358/760] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:45:12 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1739 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:45:13.493204 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-5eaffdb7-6eda-48f6-a065-b95f54e1fc9d tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:13.494688 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-5eaffdb7-6eda-48f6-a065-b95f54e1fc9d tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:13.506142 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-5eaffdb7-6eda-48f6-a065-b95f54e1fc9d tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:13.508306 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-5eaffdb7-6eda-48f6-a065-b95f54e1fc9d tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:13.511071 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-5eaffdb7-6eda-48f6-a065-b95f54e1fc9d tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:13.512526 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-5eaffdb7-6eda-48f6-a065-b95f54e1fc9d tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:13.688552 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-1f247cf8-87d6-4381-8bb7-6344e8d86cd9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:13.689338 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-1f247cf8-87d6-4381-8bb7-6344e8d86cd9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:13.723331 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1f247cf8-87d6-4381-8bb7-6344e8d86cd9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:13.724964 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1f247cf8-87d6-4381-8bb7-6344e8d86cd9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:13.729497 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1f247cf8-87d6-4381-8bb7-6344e8d86cd9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:13.734696 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1f247cf8-87d6-4381-8bb7-6344e8d86cd9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:13.964242 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-5eaffdb7-6eda-48f6-a065-b95f54e1fc9d tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:13.980697 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-5eaffdb7-6eda-48f6-a065-b95f54e1fc9d tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1723 microversion: 2.1 time: 0.487706 May 27 03:45:13.981158 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 403/761] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:45:13 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1723 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:45:14.200848 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-1f247cf8-87d6-4381-8bb7-6344e8d86cd9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:14.210221 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-1f247cf8-87d6-4381-8bb7-6344e8d86cd9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:14.211752 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-1f247cf8-87d6-4381-8bb7-6344e8d86cd9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:14.212940 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-1f247cf8-87d6-4381-8bb7-6344e8d86cd9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1739 microversion: 2.20 time: 0.528436 May 27 03:45:14.213520 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 359/762] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:45:13 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1739 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:45:14.996753 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-b2213d94-9b41-4f93-8b7d-7a1406489a6e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:14.997368 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-b2213d94-9b41-4f93-8b7d-7a1406489a6e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:15.005337 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b2213d94-9b41-4f93-8b7d-7a1406489a6e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:15.005793 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b2213d94-9b41-4f93-8b7d-7a1406489a6e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:15.006567 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b2213d94-9b41-4f93-8b7d-7a1406489a6e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:15.007008 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b2213d94-9b41-4f93-8b7d-7a1406489a6e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:15.212703 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-b2213d94-9b41-4f93-8b7d-7a1406489a6e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:15.221285 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-b2213d94-9b41-4f93-8b7d-7a1406489a6e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1723 microversion: 2.1 time: 0.228254 May 27 03:45:15.221881 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 404/763] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:45:14 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1723 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:45:15.230645 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-54dc8acc-4725-4172-a16e-770052de3f8f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:15.231253 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-54dc8acc-4725-4172-a16e-770052de3f8f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:15.239467 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-54dc8acc-4725-4172-a16e-770052de3f8f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:15.239927 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-54dc8acc-4725-4172-a16e-770052de3f8f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:15.240737 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-54dc8acc-4725-4172-a16e-770052de3f8f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:15.241182 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-54dc8acc-4725-4172-a16e-770052de3f8f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:15.433773 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-54dc8acc-4725-4172-a16e-770052de3f8f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:15.442934 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-54dc8acc-4725-4172-a16e-770052de3f8f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:15.444492 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-54dc8acc-4725-4172-a16e-770052de3f8f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:15.445640 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-54dc8acc-4725-4172-a16e-770052de3f8f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1739 microversion: 2.20 time: 0.218650 May 27 03:45:15.446200 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 360/764] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:45:15 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1739 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:45:16.237887 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-f6b7d5f7-d858-4764-983f-71ef764372b0 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:16.238520 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-f6b7d5f7-d858-4764-983f-71ef764372b0 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:16.245711 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f6b7d5f7-d858-4764-983f-71ef764372b0 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:16.246166 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f6b7d5f7-d858-4764-983f-71ef764372b0 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:16.246940 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f6b7d5f7-d858-4764-983f-71ef764372b0 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:16.247388 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f6b7d5f7-d858-4764-983f-71ef764372b0 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:16.443747 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-f6b7d5f7-d858-4764-983f-71ef764372b0 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:16.453070 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-f6b7d5f7-d858-4764-983f-71ef764372b0 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1723 microversion: 2.1 time: 0.218187 May 27 03:45:16.453645 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 405/765] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:45:16 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1723 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:45:16.462828 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-67767af9-c6cc-4281-b027-66e18a810118 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:16.463442 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-67767af9-c6cc-4281-b027-66e18a810118 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:16.470811 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-67767af9-c6cc-4281-b027-66e18a810118 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:16.471263 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-67767af9-c6cc-4281-b027-66e18a810118 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:16.472066 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-67767af9-c6cc-4281-b027-66e18a810118 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:16.472541 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-67767af9-c6cc-4281-b027-66e18a810118 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:16.664355 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-67767af9-c6cc-4281-b027-66e18a810118 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:16.672876 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-67767af9-c6cc-4281-b027-66e18a810118 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:16.674402 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-67767af9-c6cc-4281-b027-66e18a810118 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:16.675546 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-67767af9-c6cc-4281-b027-66e18a810118 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1739 microversion: 2.20 time: 0.216469 May 27 03:45:16.676103 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 361/766] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:45:16 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1739 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:45:17.469894 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-007b4b47-1974-482d-9a4e-2db19b592609 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:17.470460 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-007b4b47-1974-482d-9a4e-2db19b592609 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:17.477619 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-007b4b47-1974-482d-9a4e-2db19b592609 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:17.478067 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-007b4b47-1974-482d-9a4e-2db19b592609 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:17.478816 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-007b4b47-1974-482d-9a4e-2db19b592609 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:17.479252 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-007b4b47-1974-482d-9a4e-2db19b592609 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:17.693744 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-6de9bc8c-b584-4a01-9415-66813f68058e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:17.694390 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-6de9bc8c-b584-4a01-9415-66813f68058e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:17.701632 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6de9bc8c-b584-4a01-9415-66813f68058e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:17.702668 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6de9bc8c-b584-4a01-9415-66813f68058e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:17.703443 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6de9bc8c-b584-4a01-9415-66813f68058e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:17.703882 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6de9bc8c-b584-4a01-9415-66813f68058e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:17.808832 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-007b4b47-1974-482d-9a4e-2db19b592609 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:17.817770 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-007b4b47-1974-482d-9a4e-2db19b592609 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1723 microversion: 2.1 time: 0.352018 May 27 03:45:17.818547 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 406/767] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:45:17 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1723 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:45:17.899389 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-6de9bc8c-b584-4a01-9415-66813f68058e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:17.908742 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-6de9bc8c-b584-4a01-9415-66813f68058e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:17.910353 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-6de9bc8c-b584-4a01-9415-66813f68058e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:17.911572 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-6de9bc8c-b584-4a01-9415-66813f68058e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1739 microversion: 2.20 time: 0.221557 May 27 03:45:17.912238 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 362/768] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:45:17 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1739 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:45:18.834901 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-94dff8b5-8f44-42f3-880f-5f779ac42a36 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:18.838727 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-94dff8b5-8f44-42f3-880f-5f779ac42a36 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:18.843060 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-94dff8b5-8f44-42f3-880f-5f779ac42a36 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:18.843510 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-94dff8b5-8f44-42f3-880f-5f779ac42a36 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:18.844268 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-94dff8b5-8f44-42f3-880f-5f779ac42a36 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:18.844732 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-94dff8b5-8f44-42f3-880f-5f779ac42a36 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:18.930067 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-276c429d-7c3a-47c6-8250-abdb60f0daab tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:18.930681 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-276c429d-7c3a-47c6-8250-abdb60f0daab tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:18.937948 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-276c429d-7c3a-47c6-8250-abdb60f0daab tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:18.940649 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-276c429d-7c3a-47c6-8250-abdb60f0daab tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:18.940649 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-276c429d-7c3a-47c6-8250-abdb60f0daab tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:18.940649 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-276c429d-7c3a-47c6-8250-abdb60f0daab tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:19.132656 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-94dff8b5-8f44-42f3-880f-5f779ac42a36 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:19.141913 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-94dff8b5-8f44-42f3-880f-5f779ac42a36 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1723 microversion: 2.1 time: 0.310665 May 27 03:45:19.142473 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 407/769] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:45:18 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1723 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:45:19.146819 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-276c429d-7c3a-47c6-8250-abdb60f0daab tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:19.156271 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-276c429d-7c3a-47c6-8250-abdb60f0daab tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:19.157829 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-276c429d-7c3a-47c6-8250-abdb60f0daab tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:19.158963 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-276c429d-7c3a-47c6-8250-abdb60f0daab tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1739 microversion: 2.20 time: 0.232719 May 27 03:45:19.159506 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 363/770] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:45:18 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1739 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:45:20.161011 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-0a1992e9-9644-4c1d-a254-bd1def190e96 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:20.162376 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-0a1992e9-9644-4c1d-a254-bd1def190e96 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:20.173262 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0a1992e9-9644-4c1d-a254-bd1def190e96 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:20.174037 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0a1992e9-9644-4c1d-a254-bd1def190e96 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:20.175642 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0a1992e9-9644-4c1d-a254-bd1def190e96 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:20.176369 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0a1992e9-9644-4c1d-a254-bd1def190e96 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:20.177731 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-f7717dd2-30f4-422d-bb10-61a0c3c85755 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:20.178512 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-f7717dd2-30f4-422d-bb10-61a0c3c85755 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:20.190512 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f7717dd2-30f4-422d-bb10-61a0c3c85755 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:20.193853 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f7717dd2-30f4-422d-bb10-61a0c3c85755 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:20.194654 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f7717dd2-30f4-422d-bb10-61a0c3c85755 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:20.194654 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f7717dd2-30f4-422d-bb10-61a0c3c85755 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:20.401037 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-0a1992e9-9644-4c1d-a254-bd1def190e96 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:20.411508 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-0a1992e9-9644-4c1d-a254-bd1def190e96 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1723 microversion: 2.1 time: 0.256339 May 27 03:45:20.412486 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 408/771] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:45:20 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1723 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:45:20.417721 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-aafd3d7f-887a-4070-8b6f-62fb4b6fea16 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1538284712", "imageRef": "78c0913d-0e41-4b41-b38f-f45c4f2535ff", "flavorRef": "452", "networks": [{"uuid": "fcc8c911-2569-47b8-92dc-e0c1b7c0a740"}]}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:45:20.488691 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.network.neutron [None req-aafd3d7f-887a-4070-8b6f-62fb4b6fea16 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] validate_networks() for [('fcc8c911-2569-47b8-92dc-e0c1b7c0a740', None, None, None)] {{(pid=113020) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 27 03:45:20.608341 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-f7717dd2-30f4-422d-bb10-61a0c3c85755 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:20.618475 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-f7717dd2-30f4-422d-bb10-61a0c3c85755 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:20.620645 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-f7717dd2-30f4-422d-bb10-61a0c3c85755 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:20.622376 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-f7717dd2-30f4-422d-bb10-61a0c3c85755 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1721 microversion: 2.20 time: 0.448242 May 27 03:45:20.635986 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 364/772] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:45:20 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1721 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:45:21.091570 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.virt.hardware [None req-aafd3d7f-887a-4070-8b6f-62fb4b6fea16 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Flavor limits 0:0:0 {{(pid=113020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 27 03:45:21.092094 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.virt.hardware [None req-aafd3d7f-887a-4070-8b6f-62fb4b6fea16 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Image limits 0:0:0 {{(pid=113020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 27 03:45:21.093301 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.virt.hardware [None req-aafd3d7f-887a-4070-8b6f-62fb4b6fea16 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Flavor pref 0:0:0 {{(pid=113020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 27 03:45:21.093718 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.virt.hardware [None req-aafd3d7f-887a-4070-8b6f-62fb4b6fea16 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Image pref 0:0:0 {{(pid=113020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 27 03:45:21.094159 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.virt.hardware [None req-aafd3d7f-887a-4070-8b6f-62fb4b6fea16 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=113020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 27 03:45:21.103725 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-aafd3d7f-887a-4070-8b6f-62fb4b6fea16 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:21.104172 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-aafd3d7f-887a-4070-8b6f-62fb4b6fea16 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:21.105021 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-aafd3d7f-887a-4070-8b6f-62fb4b6fea16 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:21.105455 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-aafd3d7f-887a-4070-8b6f-62fb4b6fea16 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:21.123246 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.quota [None req-aafd3d7f-887a-4070-8b6f-62fb4b6fea16 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Getting quotas for project 00dc5f669f3f483bacc0bf258a11c302. Resources: {'instances', 'cores', 'ram'} {{(pid=113020) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 27 03:45:21.127281 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.quota [None req-aafd3d7f-887a-4070-8b6f-62fb4b6fea16 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Getting quotas for user 71289d2497de4089bfcdae8474859196 and project 00dc5f669f3f483bacc0bf258a11c302. Resources: {'instances', 'cores', 'ram'} {{(pid=113020) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 27 03:45:21.138042 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-aafd3d7f-887a-4070-8b6f-62fb4b6fea16 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Going to run 1 instances... {{(pid=113020) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 27 03:45:21.140435 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-aafd3d7f-887a-4070-8b6f-62fb4b6fea16 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] [instance: 365c2ebc-713f-475e-a586-fa68bb6b3064] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78c0913d-0e41-4b41-b38f-f45c4f2535ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=113020) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 27 03:45:21.262402 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-aafd3d7f-887a-4070-8b6f-62fb4b6fea16 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.848614 May 27 03:45:21.263134 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 409/773] 10.222.0.25 () {60 vars in 1147 bytes} [Thu May 27 03:45:20 2021] POST /compute/v2.1/servers => generated 380 bytes in 850 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 03:45:21.272687 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-caec4493-f359-4d7c-96f1-a7a71858e53f tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:21.273415 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-caec4493-f359-4d7c-96f1-a7a71858e53f tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] [instance: 365c2ebc-713f-475e-a586-fa68bb6b3064] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:21.351263 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-caec4493-f359-4d7c-96f1-a7a71858e53f tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71289d2497de4089bfcdae8474859196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dc5f669f3f483bacc0bf258a11c302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:21.358990 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-caec4493-f359-4d7c-96f1-a7a71858e53f tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] 10.222.0.25 "GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064" status: 200 len: 1219 microversion: 2.1 time: 0.089853 May 27 03:45:21.359541 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 365/774] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:45:21 2021] GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:45:21.429266 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-0c59aea8-5de7-452d-8585-ca8f4d37bad6 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:21.431259 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-0c59aea8-5de7-452d-8585-ca8f4d37bad6 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:21.437578 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0c59aea8-5de7-452d-8585-ca8f4d37bad6 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:21.438112 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0c59aea8-5de7-452d-8585-ca8f4d37bad6 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:21.438893 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0c59aea8-5de7-452d-8585-ca8f4d37bad6 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:21.439343 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0c59aea8-5de7-452d-8585-ca8f4d37bad6 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:21.639213 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-0c59aea8-5de7-452d-8585-ca8f4d37bad6 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:21.642649 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-3e10be72-19a0-4b0b-989f-dfca3fc27873 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:21.643261 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-3e10be72-19a0-4b0b-989f-dfca3fc27873 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:21.648725 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-0c59aea8-5de7-452d-8585-ca8f4d37bad6 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1723 microversion: 2.1 time: 0.223190 May 27 03:45:21.649486 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 410/775] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:45:21 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1723 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:45:21.650992 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-3e10be72-19a0-4b0b-989f-dfca3fc27873 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:21.651451 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-3e10be72-19a0-4b0b-989f-dfca3fc27873 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:21.652225 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-3e10be72-19a0-4b0b-989f-dfca3fc27873 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:21.652683 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-3e10be72-19a0-4b0b-989f-dfca3fc27873 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:21.855104 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-3e10be72-19a0-4b0b-989f-dfca3fc27873 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:21.864492 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-3e10be72-19a0-4b0b-989f-dfca3fc27873 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:21.866034 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-3e10be72-19a0-4b0b-989f-dfca3fc27873 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:21.867177 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-3e10be72-19a0-4b0b-989f-dfca3fc27873 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1721 microversion: 2.20 time: 0.228232 May 27 03:45:21.867732 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 366/776] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:45:21 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1721 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:45:21.883143 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-48d6beb5-5088-4bd8-9ad5-13e9a9746b21 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:21.883873 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-48d6beb5-5088-4bd8-9ad5-13e9a9746b21 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] [instance: daffe717-7636-45e8-813d-8b2a6075c61e] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:21.891055 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-48d6beb5-5088-4bd8-9ad5-13e9a9746b21 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:21.891508 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-48d6beb5-5088-4bd8-9ad5-13e9a9746b21 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:21.892277 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-48d6beb5-5088-4bd8-9ad5-13e9a9746b21 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:21.892761 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-48d6beb5-5088-4bd8-9ad5-13e9a9746b21 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:22.085900 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-48d6beb5-5088-4bd8-9ad5-13e9a9746b21 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf67cc7398a4e1cb6f565ebe2241e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df96baa86bb4c51b3b8bece28e3e23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:22.095068 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-48d6beb5-5088-4bd8-9ad5-13e9a9746b21 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] 10.222.0.25 "GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e" status: 200 len: 1593 microversion: 2.1 time: 0.215612 May 27 03:45:22.095621 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 411/777] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:45:21 2021] GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e => generated 1593 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:45:22.375742 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-3ffb1ea1-71d8-4095-a05a-1521730cb942 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:22.376690 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-3ffb1ea1-71d8-4095-a05a-1521730cb942 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] [instance: 365c2ebc-713f-475e-a586-fa68bb6b3064] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:22.384323 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-3ffb1ea1-71d8-4095-a05a-1521730cb942 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:22.384856 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-3ffb1ea1-71d8-4095-a05a-1521730cb942 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:22.385647 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-3ffb1ea1-71d8-4095-a05a-1521730cb942 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:22.386139 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-3ffb1ea1-71d8-4095-a05a-1521730cb942 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:22.500246 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-3ffb1ea1-71d8-4095-a05a-1521730cb942 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71289d2497de4089bfcdae8474859196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dc5f669f3f483bacc0bf258a11c302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:22.508347 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-3ffb1ea1-71d8-4095-a05a-1521730cb942 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] 10.222.0.25 "GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064" status: 200 len: 1223 microversion: 2.1 time: 0.136330 May 27 03:45:22.510266 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 367/778] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:45:22 2021] GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064 => generated 1223 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:45:22.665902 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-41161c4a-d89e-4f03-9284-dea375066b4c tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:22.666521 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-41161c4a-d89e-4f03-9284-dea375066b4c tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:22.674784 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-41161c4a-d89e-4f03-9284-dea375066b4c tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:22.675237 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-41161c4a-d89e-4f03-9284-dea375066b4c tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:22.676028 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-41161c4a-d89e-4f03-9284-dea375066b4c tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:22.676495 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-41161c4a-d89e-4f03-9284-dea375066b4c tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:22.884705 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-f10dd433-5001-4513-8b0c-371323168665 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:22.885277 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-f10dd433-5001-4513-8b0c-371323168665 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:22.892469 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f10dd433-5001-4513-8b0c-371323168665 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:22.892931 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f10dd433-5001-4513-8b0c-371323168665 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:22.893700 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f10dd433-5001-4513-8b0c-371323168665 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:22.894143 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f10dd433-5001-4513-8b0c-371323168665 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:23.003937 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-41161c4a-d89e-4f03-9284-dea375066b4c tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:23.012931 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-41161c4a-d89e-4f03-9284-dea375066b4c tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1723 microversion: 2.1 time: 0.350914 May 27 03:45:23.013504 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 412/779] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:45:22 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1723 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:45:23.091416 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-f10dd433-5001-4513-8b0c-371323168665 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:23.099965 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-f10dd433-5001-4513-8b0c-371323168665 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:23.104451 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-f10dd433-5001-4513-8b0c-371323168665 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:23.104451 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-f10dd433-5001-4513-8b0c-371323168665 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1721 microversion: 2.20 time: 0.221900 May 27 03:45:23.104451 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 368/780] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:45:22 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1721 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:45:23.524944 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-da9c763a-ff68-4fb6-b53e-9cdb222df22f tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:23.525692 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-da9c763a-ff68-4fb6-b53e-9cdb222df22f tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] [instance: 365c2ebc-713f-475e-a586-fa68bb6b3064] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:23.533394 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-da9c763a-ff68-4fb6-b53e-9cdb222df22f tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:23.533851 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-da9c763a-ff68-4fb6-b53e-9cdb222df22f tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:23.534619 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-da9c763a-ff68-4fb6-b53e-9cdb222df22f tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:23.535058 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-da9c763a-ff68-4fb6-b53e-9cdb222df22f tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:23.648625 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-da9c763a-ff68-4fb6-b53e-9cdb222df22f tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71289d2497de4089bfcdae8474859196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dc5f669f3f483bacc0bf258a11c302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:23.657230 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-da9c763a-ff68-4fb6-b53e-9cdb222df22f tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] 10.222.0.25 "GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064" status: 200 len: 1223 microversion: 2.1 time: 0.136044 May 27 03:45:23.658041 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 413/781] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:45:23 2021] GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064 => generated 1223 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:45:23.962806 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [req-daf44756-b0f1-4bc9-8dea-4786afe9bcff req-7f3c4bff-e807-49ae-bce2-4f4346fbe9e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e367eb4b-29c5-4f41-b41d-0da84d751fe2", "name": "network-vif-unplugged", "status": "completed", "tag": "396ee32c-72a8-43ea-b35c-f0de6de19d7a"}]} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:45:23.964581 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:45:23.964581 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: warnings.warn(msg) May 27 03:45:23.973470 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-daf44756-b0f1-4bc9-8dea-4786afe9bcff req-7f3c4bff-e807-49ae-bce2-4f4346fbe9e8 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:23.976551 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-daf44756-b0f1-4bc9-8dea-4786afe9bcff req-7f3c4bff-e807-49ae-bce2-4f4346fbe9e8 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:23.989927 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.compute.server_external_events [req-daf44756-b0f1-4bc9-8dea-4786afe9bcff req-7f3c4bff-e807-49ae-bce2-4f4346fbe9e8 service nova] Creating event network-vif-unplugged:396ee32c-72a8-43ea-b35c-f0de6de19d7a for instance e367eb4b-29c5-4f41-b41d-0da84d751fe2 on hv-cinder-79326 May 27 03:45:23.994973 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [req-daf44756-b0f1-4bc9-8dea-4786afe9bcff req-7f3c4bff-e807-49ae-bce2-4f4346fbe9e8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036319 May 27 03:45:23.995808 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 369/782] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:45:23 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:45:24.029062 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-f3c9474e-b3c6-4fc6-868a-d8d63749fd37 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:24.029685 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-f3c9474e-b3c6-4fc6-868a-d8d63749fd37 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:24.037229 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f3c9474e-b3c6-4fc6-868a-d8d63749fd37 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:24.039049 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f3c9474e-b3c6-4fc6-868a-d8d63749fd37 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:24.039049 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f3c9474e-b3c6-4fc6-868a-d8d63749fd37 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:24.039261 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f3c9474e-b3c6-4fc6-868a-d8d63749fd37 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:24.122252 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-1f7b7d96-4da0-4b68-b435-9a93c9108f8f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:24.123178 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-1f7b7d96-4da0-4b68-b435-9a93c9108f8f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:24.131521 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1f7b7d96-4da0-4b68-b435-9a93c9108f8f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:24.132064 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1f7b7d96-4da0-4b68-b435-9a93c9108f8f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:24.132870 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1f7b7d96-4da0-4b68-b435-9a93c9108f8f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:24.133317 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1f7b7d96-4da0-4b68-b435-9a93c9108f8f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:24.335537 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-1f7b7d96-4da0-4b68-b435-9a93c9108f8f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:24.344362 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-1f7b7d96-4da0-4b68-b435-9a93c9108f8f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:24.345921 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-1f7b7d96-4da0-4b68-b435-9a93c9108f8f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:24.347779 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-1f7b7d96-4da0-4b68-b435-9a93c9108f8f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1721 microversion: 2.20 time: 0.230129 May 27 03:45:24.347779 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 370/783] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:45:24 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1721 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:45:24.498060 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-f3c9474e-b3c6-4fc6-868a-d8d63749fd37 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:24.507724 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-f3c9474e-b3c6-4fc6-868a-d8d63749fd37 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1723 microversion: 2.1 time: 0.482331 May 27 03:45:24.508316 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 414/784] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:45:24 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1723 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:45:24.674410 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-55f11392-29e3-4639-90e6-57f02c07e62f tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:24.674932 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-55f11392-29e3-4639-90e6-57f02c07e62f tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] [instance: 365c2ebc-713f-475e-a586-fa68bb6b3064] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:24.682279 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-55f11392-29e3-4639-90e6-57f02c07e62f tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:24.682734 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-55f11392-29e3-4639-90e6-57f02c07e62f tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:24.683508 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-55f11392-29e3-4639-90e6-57f02c07e62f tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:24.683950 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-55f11392-29e3-4639-90e6-57f02c07e62f tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:24.794504 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-55f11392-29e3-4639-90e6-57f02c07e62f tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71289d2497de4089bfcdae8474859196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dc5f669f3f483bacc0bf258a11c302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:24.803278 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-55f11392-29e3-4639-90e6-57f02c07e62f tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] 10.222.0.25 "GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064" status: 200 len: 1223 microversion: 2.1 time: 0.133221 May 27 03:45:24.804012 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 371/785] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:45:24 2021] GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064 => generated 1223 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:45:25.257802 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [req-266bf648-5506-4462-839d-989afaa8537d req-dd141202-67da-4af1-927b-a9fdb4459983 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "daffe717-7636-45e8-813d-8b2a6075c61e", "tag": "2beacebc-a476-4d0c-ad0f-528ef5b957c8"}]} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:45:25.259920 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:45:25.259920 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: warnings.warn(msg) May 27 03:45:25.269577 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-266bf648-5506-4462-839d-989afaa8537d req-dd141202-67da-4af1-927b-a9fdb4459983 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:25.270032 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-266bf648-5506-4462-839d-989afaa8537d req-dd141202-67da-4af1-927b-a9fdb4459983 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:25.292882 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.compute.server_external_events [req-266bf648-5506-4462-839d-989afaa8537d req-dd141202-67da-4af1-927b-a9fdb4459983 service nova] Creating event network-changed:2beacebc-a476-4d0c-ad0f-528ef5b957c8 for instance daffe717-7636-45e8-813d-8b2a6075c61e on hv-cinder-79326 May 27 03:45:25.298700 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [req-266bf648-5506-4462-839d-989afaa8537d req-dd141202-67da-4af1-927b-a9fdb4459983 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044863 May 27 03:45:25.299287 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 415/786] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:45:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:45:25.366847 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-51158fa1-8d04-4ef1-bfd8-cfffae80cb18 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:25.367550 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-51158fa1-8d04-4ef1-bfd8-cfffae80cb18 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:25.376224 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-51158fa1-8d04-4ef1-bfd8-cfffae80cb18 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:25.376787 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-51158fa1-8d04-4ef1-bfd8-cfffae80cb18 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:25.377683 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-51158fa1-8d04-4ef1-bfd8-cfffae80cb18 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:25.378350 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-51158fa1-8d04-4ef1-bfd8-cfffae80cb18 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:25.525468 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-34a56fc4-c8a7-48e1-a8cd-1c61d325731b tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:25.526617 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-34a56fc4-c8a7-48e1-a8cd-1c61d325731b tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:25.534173 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-34a56fc4-c8a7-48e1-a8cd-1c61d325731b tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:25.534878 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-34a56fc4-c8a7-48e1-a8cd-1c61d325731b tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:25.535620 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-34a56fc4-c8a7-48e1-a8cd-1c61d325731b tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:25.536543 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-34a56fc4-c8a7-48e1-a8cd-1c61d325731b tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:25.644204 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-51158fa1-8d04-4ef1-bfd8-cfffae80cb18 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:25.656112 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-51158fa1-8d04-4ef1-bfd8-cfffae80cb18 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:25.659843 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-51158fa1-8d04-4ef1-bfd8-cfffae80cb18 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:25.661238 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-51158fa1-8d04-4ef1-bfd8-cfffae80cb18 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1721 microversion: 2.20 time: 0.298660 May 27 03:45:25.662037 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 372/787] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:45:25 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1721 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:45:25.773456 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-34a56fc4-c8a7-48e1-a8cd-1c61d325731b tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:25.782425 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-34a56fc4-c8a7-48e1-a8cd-1c61d325731b tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1723 microversion: 2.1 time: 0.261080 May 27 03:45:25.792531 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 416/788] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:45:25 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1723 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:45:25.819193 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-34c2ed1e-3c37-4294-9a40-d90c8a9c8122 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:25.819810 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-34c2ed1e-3c37-4294-9a40-d90c8a9c8122 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] [instance: 365c2ebc-713f-475e-a586-fa68bb6b3064] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:25.829459 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-34c2ed1e-3c37-4294-9a40-d90c8a9c8122 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:25.830322 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-34c2ed1e-3c37-4294-9a40-d90c8a9c8122 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:25.831118 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-34c2ed1e-3c37-4294-9a40-d90c8a9c8122 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:25.831562 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-34c2ed1e-3c37-4294-9a40-d90c8a9c8122 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:25.950178 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-34c2ed1e-3c37-4294-9a40-d90c8a9c8122 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71289d2497de4089bfcdae8474859196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dc5f669f3f483bacc0bf258a11c302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:25.958497 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-34c2ed1e-3c37-4294-9a40-d90c8a9c8122 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] 10.222.0.25 "GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064" status: 200 len: 1215 microversion: 2.1 time: 0.143184 May 27 03:45:25.959106 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 373/789] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:45:25 2021] GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064 => generated 1215 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:45:26.679709 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-9913eeda-693a-4967-b3ab-32a0037e5798 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:26.680291 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-9913eeda-693a-4967-b3ab-32a0037e5798 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:26.687590 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9913eeda-693a-4967-b3ab-32a0037e5798 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:26.688039 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9913eeda-693a-4967-b3ab-32a0037e5798 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:26.688848 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9913eeda-693a-4967-b3ab-32a0037e5798 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:26.689286 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9913eeda-693a-4967-b3ab-32a0037e5798 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:26.799301 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-51911e32-c50e-4833-94f7-d47cc9b5b240 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:26.799944 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-51911e32-c50e-4833-94f7-d47cc9b5b240 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:26.807353 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-51911e32-c50e-4833-94f7-d47cc9b5b240 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:26.807825 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-51911e32-c50e-4833-94f7-d47cc9b5b240 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:26.808656 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-51911e32-c50e-4833-94f7-d47cc9b5b240 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:26.809103 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-51911e32-c50e-4833-94f7-d47cc9b5b240 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:26.909163 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-9913eeda-693a-4967-b3ab-32a0037e5798 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:26.919080 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-9913eeda-693a-4967-b3ab-32a0037e5798 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:26.920942 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-9913eeda-693a-4967-b3ab-32a0037e5798 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:26.922182 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-9913eeda-693a-4967-b3ab-32a0037e5798 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1721 microversion: 2.20 time: 0.246363 May 27 03:45:26.922938 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 417/790] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:45:26 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1721 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:45:26.978365 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-3d750a95-ae62-4eb1-88b5-6cc3252a4e40 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:26.979118 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-3d750a95-ae62-4eb1-88b5-6cc3252a4e40 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] [instance: 365c2ebc-713f-475e-a586-fa68bb6b3064] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:26.986597 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3d750a95-ae62-4eb1-88b5-6cc3252a4e40 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:26.987055 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3d750a95-ae62-4eb1-88b5-6cc3252a4e40 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:26.987832 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3d750a95-ae62-4eb1-88b5-6cc3252a4e40 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:26.988588 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3d750a95-ae62-4eb1-88b5-6cc3252a4e40 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:27.106120 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-3d750a95-ae62-4eb1-88b5-6cc3252a4e40 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71289d2497de4089bfcdae8474859196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dc5f669f3f483bacc0bf258a11c302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:27.115258 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-3d750a95-ae62-4eb1-88b5-6cc3252a4e40 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] 10.222.0.25 "GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064" status: 200 len: 1215 microversion: 2.1 time: 0.140733 May 27 03:45:27.115826 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 418/791] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:45:26 2021] GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064 => generated 1215 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:45:27.214660 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-51911e32-c50e-4833-94f7-d47cc9b5b240 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:27.224701 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-51911e32-c50e-4833-94f7-d47cc9b5b240 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1723 microversion: 2.1 time: 0.429047 May 27 03:45:27.225314 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 374/792] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:45:26 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1723 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:45:27.940468 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-eb152d41-40c2-470e-84e0-78998f89824f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:27.940886 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-eb152d41-40c2-470e-84e0-78998f89824f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:27.947976 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-eb152d41-40c2-470e-84e0-78998f89824f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:27.953143 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-eb152d41-40c2-470e-84e0-78998f89824f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:27.953143 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-eb152d41-40c2-470e-84e0-78998f89824f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:27.953143 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-eb152d41-40c2-470e-84e0-78998f89824f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:28.112459 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-9b9bcea4-9df4-4c78-b26f-6a67dc69539e tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-81960653"}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:45:28.113094 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-9b9bcea4-9df4-4c78-b26f-6a67dc69539e tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] [instance: daffe717-7636-45e8-813d-8b2a6075c61e] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:28.129116 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-9b9bcea4-9df4-4c78-b26f-6a67dc69539e tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:28.129823 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-9b9bcea4-9df4-4c78-b26f-6a67dc69539e tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:28.130615 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-9b9bcea4-9df4-4c78-b26f-6a67dc69539e tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:28.131179 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-9b9bcea4-9df4-4c78-b26f-6a67dc69539e tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:28.168388 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-eb152d41-40c2-470e-84e0-78998f89824f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:28.177856 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-eb152d41-40c2-470e-84e0-78998f89824f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:28.179396 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-eb152d41-40c2-470e-84e0-78998f89824f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:28.180648 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-eb152d41-40c2-470e-84e0-78998f89824f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1721 microversion: 2.20 time: 0.244627 May 27 03:45:28.181209 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 419/793] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:45:27 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1721 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:45:28.185709 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-e41d87cf-403e-436b-af99-e6ac6ced64a2 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:28.186620 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-e41d87cf-403e-436b-af99-e6ac6ced64a2 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] [instance: 365c2ebc-713f-475e-a586-fa68bb6b3064] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:28.195368 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e41d87cf-403e-436b-af99-e6ac6ced64a2 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:28.195827 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e41d87cf-403e-436b-af99-e6ac6ced64a2 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:28.196652 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e41d87cf-403e-436b-af99-e6ac6ced64a2 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:28.197098 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e41d87cf-403e-436b-af99-e6ac6ced64a2 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:28.315141 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-e41d87cf-403e-436b-af99-e6ac6ced64a2 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71289d2497de4089bfcdae8474859196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dc5f669f3f483bacc0bf258a11c302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:28.323261 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-e41d87cf-403e-436b-af99-e6ac6ced64a2 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] 10.222.0.25 "GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064" status: 200 len: 1271 microversion: 2.1 time: 0.140909 May 27 03:45:28.323826 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 420/794] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:45:28 2021] GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064 => generated 1271 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:45:28.329152 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-05109734-59af-4ca9-9db4-777c10eba982 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:28.329669 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-05109734-59af-4ca9-9db4-777c10eba982 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:28.336867 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-05109734-59af-4ca9-9db4-777c10eba982 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:28.337321 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-05109734-59af-4ca9-9db4-777c10eba982 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:28.338125 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-05109734-59af-4ca9-9db4-777c10eba982 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:28.338564 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-05109734-59af-4ca9-9db4-777c10eba982 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:28.567393 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-05109734-59af-4ca9-9db4-777c10eba982 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:28.597933 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-05109734-59af-4ca9-9db4-777c10eba982 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1723 microversion: 2.1 time: 0.273044 May 27 03:45:28.598519 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 421/795] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:45:28 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1723 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:45:28.670944 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.network.security_group_api [None req-9b9bcea4-9df4-4c78-b26f-6a67dc69539e tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Adding security group ddcda7fa-20c2-4652-a278-ed29013fdd44 to port 2beacebc-a476-4d0c-ad0f-528ef5b957c8 May 27 03:45:29.199256 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-caf5c893-a650-4f8f-a366-96903731d23c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:29.199920 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-caf5c893-a650-4f8f-a366-96903731d23c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:29.207172 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-caf5c893-a650-4f8f-a366-96903731d23c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:29.207627 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-caf5c893-a650-4f8f-a366-96903731d23c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:29.208425 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-caf5c893-a650-4f8f-a366-96903731d23c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:29.208875 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-caf5c893-a650-4f8f-a366-96903731d23c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:29.401718 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-caf5c893-a650-4f8f-a366-96903731d23c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:29.410959 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-caf5c893-a650-4f8f-a366-96903731d23c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:29.412864 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-caf5c893-a650-4f8f-a366-96903731d23c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:29.413976 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-caf5c893-a650-4f8f-a366-96903731d23c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1664 microversion: 2.20 time: 0.218610 May 27 03:45:29.414525 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 422/796] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:45:29 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1664 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:45:29.428995 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-8dd5c2b7-184d-4817-b4c3-209738096539 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:29.429640 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-8dd5c2b7-184d-4817-b4c3-209738096539 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] [instance: 365c2ebc-713f-475e-a586-fa68bb6b3064] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:29.437064 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8dd5c2b7-184d-4817-b4c3-209738096539 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:29.437575 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8dd5c2b7-184d-4817-b4c3-209738096539 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:29.438363 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8dd5c2b7-184d-4817-b4c3-209738096539 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:29.438807 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8dd5c2b7-184d-4817-b4c3-209738096539 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:29.557031 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-8dd5c2b7-184d-4817-b4c3-209738096539 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71289d2497de4089bfcdae8474859196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dc5f669f3f483bacc0bf258a11c302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:29.565888 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-8dd5c2b7-184d-4817-b4c3-209738096539 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] 10.222.0.25 "GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064" status: 200 len: 1277 microversion: 2.1 time: 0.140481 May 27 03:45:29.566680 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 423/797] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:45:29 2021] GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064 => generated 1277 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:45:29.579816 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-25fef2d4-be89-455b-8f34-026fdf81867a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1e8bb561-2451-42cb-95e9-3bbd0879295b"}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:45:29.581087 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-25fef2d4-be89-455b-8f34-026fdf81867a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:29.603824 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-25fef2d4-be89-455b-8f34-026fdf81867a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:29.604645 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-25fef2d4-be89-455b-8f34-026fdf81867a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:29.604787 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-9b9bcea4-9df4-4c78-b26f-6a67dc69539e tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] 10.222.0.25 "POST /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e/action" status: 202 len: 0 microversion: 2.1 time: 1.496264 May 27 03:45:29.605913 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 375/798] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:45:28 2021] POST /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e/action => generated 0 bytes in 1498 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 27 03:45:29.606648 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-25fef2d4-be89-455b-8f34-026fdf81867a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:29.607651 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-25fef2d4-be89-455b-8f34-026fdf81867a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:29.615801 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-737693b9-b95c-42bc-b365-4c86025674ee tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:29.616632 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-737693b9-b95c-42bc-b365-4c86025674ee tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] [instance: daffe717-7636-45e8-813d-8b2a6075c61e] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:29.627055 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-737693b9-b95c-42bc-b365-4c86025674ee tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:29.627533 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-737693b9-b95c-42bc-b365-4c86025674ee tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:29.628308 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-737693b9-b95c-42bc-b365-4c86025674ee tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:29.628777 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-737693b9-b95c-42bc-b365-4c86025674ee tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:29.977296 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-737693b9-b95c-42bc-b365-4c86025674ee tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf67cc7398a4e1cb6f565ebe2241e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df96baa86bb4c51b3b8bece28e3e23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:29.986902 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-737693b9-b95c-42bc-b365-4c86025674ee tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] 10.222.0.25 "GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e" status: 200 len: 1757 microversion: 2.1 time: 0.375881 May 27 03:45:29.988011 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 376/799] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:45:29 2021] GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e => generated 1757 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:45:29.992829 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-542e84e0-f75f-44e3-b88a-9bd200ae89e6 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:29.996585 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-542e84e0-f75f-44e3-b88a-9bd200ae89e6 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:30.002070 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-542e84e0-f75f-44e3-b88a-9bd200ae89e6 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:30.002566 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-542e84e0-f75f-44e3-b88a-9bd200ae89e6 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:30.003300 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-542e84e0-f75f-44e3-b88a-9bd200ae89e6 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:30.003860 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-542e84e0-f75f-44e3-b88a-9bd200ae89e6 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:30.349966 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-542e84e0-f75f-44e3-b88a-9bd200ae89e6 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:30.359130 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-542e84e0-f75f-44e3-b88a-9bd200ae89e6 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1723 microversion: 2.1 time: 0.369914 May 27 03:45:30.359771 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 377/800] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:45:29 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1723 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:45:30.364115 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [req-ef010ee3-9af0-4e6b-bcf9-e940b5997138 req-ec99f133-a6bc-41ff-9009-35225237dde5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "daffe717-7636-45e8-813d-8b2a6075c61e", "tag": "2beacebc-a476-4d0c-ad0f-528ef5b957c8"}]} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:45:30.365718 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:45:30.365718 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: warnings.warn(msg) May 27 03:45:30.374186 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-ef010ee3-9af0-4e6b-bcf9-e940b5997138 req-ec99f133-a6bc-41ff-9009-35225237dde5 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:30.374855 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-ef010ee3-9af0-4e6b-bcf9-e940b5997138 req-ec99f133-a6bc-41ff-9009-35225237dde5 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:30.391685 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.compute.server_external_events [req-ef010ee3-9af0-4e6b-bcf9-e940b5997138 req-ec99f133-a6bc-41ff-9009-35225237dde5 service nova] Creating event network-changed:2beacebc-a476-4d0c-ad0f-528ef5b957c8 for instance daffe717-7636-45e8-813d-8b2a6075c61e on hv-cinder-79326 May 27 03:45:30.397034 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [req-ef010ee3-9af0-4e6b-bcf9-e940b5997138 req-ec99f133-a6bc-41ff-9009-35225237dde5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036056 May 27 03:45:30.401636 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 378/801] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:45:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:45:30.583518 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-8a87da3f-856f-4a77-9345-10d847c13fc9 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:30.584231 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-8a87da3f-856f-4a77-9345-10d847c13fc9 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] [instance: 365c2ebc-713f-475e-a586-fa68bb6b3064] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:30.591757 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8a87da3f-856f-4a77-9345-10d847c13fc9 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:30.597544 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8a87da3f-856f-4a77-9345-10d847c13fc9 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:30.597544 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8a87da3f-856f-4a77-9345-10d847c13fc9 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:30.597544 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8a87da3f-856f-4a77-9345-10d847c13fc9 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:30.936608 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-25fef2d4-be89-455b-8f34-026fdf81867a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.361253 May 27 03:45:30.937220 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 424/802] 10.222.0.25 () {62 vars in 1364 bytes} [Thu May 27 03:45:29 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/os-volume_attachments => generated 188 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:45:31.040232 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-1a04412a-a681-4631-ba86-c13880178d14 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:45:31.040852 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-1a04412a-a681-4631-ba86-c13880178d14 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:31.048733 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1a04412a-a681-4631-ba86-c13880178d14 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:31.049183 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1a04412a-a681-4631-ba86-c13880178d14 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:31.050636 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1a04412a-a681-4631-ba86-c13880178d14 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:31.051095 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1a04412a-a681-4631-ba86-c13880178d14 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:31.308943 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-1a04412a-a681-4631-ba86-c13880178d14 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action" status: 202 len: 0 microversion: 2.20 time: 0.272354 May 27 03:45:31.310147 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 425/803] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:45:31 2021] POST /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 27 03:45:31.317723 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-31b5093a-000c-4141-9810-b0b9d31bab1c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:31.318760 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-31b5093a-000c-4141-9810-b0b9d31bab1c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:31.327186 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-31b5093a-000c-4141-9810-b0b9d31bab1c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:31.327635 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-31b5093a-000c-4141-9810-b0b9d31bab1c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:31.328434 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-31b5093a-000c-4141-9810-b0b9d31bab1c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:31.328874 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-31b5093a-000c-4141-9810-b0b9d31bab1c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:31.372683 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-8a87da3f-856f-4a77-9345-10d847c13fc9 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71289d2497de4089bfcdae8474859196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dc5f669f3f483bacc0bf258a11c302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:31.386297 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-8a87da3f-856f-4a77-9345-10d847c13fc9 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] 10.222.0.25 "GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064" status: 200 len: 1319 microversion: 2.1 time: 0.806444 May 27 03:45:31.387438 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 379/804] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:45:30 2021] GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064 => generated 1319 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:45:31.395298 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-e0e2ec27-f014-42ed-8c11-0d3db5fd4635 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:31.396240 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-e0e2ec27-f014-42ed-8c11-0d3db5fd4635 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:31.407986 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e0e2ec27-f014-42ed-8c11-0d3db5fd4635 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:31.408543 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e0e2ec27-f014-42ed-8c11-0d3db5fd4635 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:31.409605 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e0e2ec27-f014-42ed-8c11-0d3db5fd4635 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:31.410302 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e0e2ec27-f014-42ed-8c11-0d3db5fd4635 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:31.536490 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-31b5093a-000c-4141-9810-b0b9d31bab1c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:31.549376 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-31b5093a-000c-4141-9810-b0b9d31bab1c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:31.551089 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-31b5093a-000c-4141-9810-b0b9d31bab1c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:31.552396 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-31b5093a-000c-4141-9810-b0b9d31bab1c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1750 microversion: 2.20 time: 0.238398 May 27 03:45:31.553367 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 426/805] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:45:31 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1750 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:45:31.970429 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-e0e2ec27-f014-42ed-8c11-0d3db5fd4635 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:31.979468 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-e0e2ec27-f014-42ed-8c11-0d3db5fd4635 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1700 microversion: 2.1 time: 0.590318 May 27 03:45:31.980254 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 380/806] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:45:31 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1700 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:45:31.996954 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-9497df44-370a-4316-ab55-4e0a8b1adabe tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:45:32.006495 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9497df44-370a-4316-ab55-4e0a8b1adabe tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:32.006957 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9497df44-370a-4316-ab55-4e0a8b1adabe tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:32.067680 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-9497df44-370a-4316-ab55-4e0a8b1adabe tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Going to try to start instance {{(pid=113020) start /opt/stack/nova/nova/compute/api.py:2602}} May 27 03:45:32.269358 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-9497df44-370a-4316-ab55-4e0a8b1adabe tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 202 len: 0 microversion: 2.1 time: 0.276350 May 27 03:45:32.269954 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 427/807] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:45:31 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:45:32.277761 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-d1a341e7-a7bd-4948-8c92-f23f2c04c7c0 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:32.278373 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-d1a341e7-a7bd-4948-8c92-f23f2c04c7c0 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:32.286057 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d1a341e7-a7bd-4948-8c92-f23f2c04c7c0 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:32.286508 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d1a341e7-a7bd-4948-8c92-f23f2c04c7c0 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:32.287275 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d1a341e7-a7bd-4948-8c92-f23f2c04c7c0 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:32.287982 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d1a341e7-a7bd-4948-8c92-f23f2c04c7c0 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:32.405145 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-e89215c1-7573-4b81-9657-7e277547e2c3 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:32.406121 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-e89215c1-7573-4b81-9657-7e277547e2c3 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] [instance: 365c2ebc-713f-475e-a586-fa68bb6b3064] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:32.413950 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e89215c1-7573-4b81-9657-7e277547e2c3 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:32.414403 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e89215c1-7573-4b81-9657-7e277547e2c3 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:32.415186 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e89215c1-7573-4b81-9657-7e277547e2c3 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:32.415636 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e89215c1-7573-4b81-9657-7e277547e2c3 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:32.483974 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-d1a341e7-a7bd-4948-8c92-f23f2c04c7c0 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:32.492985 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-d1a341e7-a7bd-4948-8c92-f23f2c04c7c0 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1709 microversion: 2.1 time: 0.218772 May 27 03:45:32.493734 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 381/808] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:45:32 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1709 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:45:32.498469 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [req-24a08aea-ebbb-4066-b72a-c8cbc8f293c4 req-87a9c60b-fd6c-4558-bc20-d5616cae3006 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "365c2ebc-713f-475e-a586-fa68bb6b3064", "tag": "490a8b44-4014-4b14-b088-dca46edd2c29"}]} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:45:32.500359 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:45:32.500359 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: warnings.warn(msg) May 27 03:45:32.508853 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-24a08aea-ebbb-4066-b72a-c8cbc8f293c4 req-87a9c60b-fd6c-4558-bc20-d5616cae3006 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:32.509413 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-24a08aea-ebbb-4066-b72a-c8cbc8f293c4 req-87a9c60b-fd6c-4558-bc20-d5616cae3006 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:32.525526 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.compute.server_external_events [req-24a08aea-ebbb-4066-b72a-c8cbc8f293c4 req-87a9c60b-fd6c-4558-bc20-d5616cae3006 service nova] Creating event network-changed:490a8b44-4014-4b14-b088-dca46edd2c29 for instance 365c2ebc-713f-475e-a586-fa68bb6b3064 on hv-cinder-79326 May 27 03:45:32.530825 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [req-24a08aea-ebbb-4066-b72a-c8cbc8f293c4 req-87a9c60b-fd6c-4558-bc20-d5616cae3006 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035746 May 27 03:45:32.531504 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 382/809] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:45:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:45:32.571760 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-9ca9279e-7d42-489f-ab78-a3c85f1f6be8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:32.572621 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-9ca9279e-7d42-489f-ab78-a3c85f1f6be8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:32.580984 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-9ca9279e-7d42-489f-ab78-a3c85f1f6be8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:32.581426 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-9ca9279e-7d42-489f-ab78-a3c85f1f6be8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:32.582209 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-9ca9279e-7d42-489f-ab78-a3c85f1f6be8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:32.582651 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-9ca9279e-7d42-489f-ab78-a3c85f1f6be8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:32.706295 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-e89215c1-7573-4b81-9657-7e277547e2c3 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71289d2497de4089bfcdae8474859196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dc5f669f3f483bacc0bf258a11c302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:32.714362 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-e89215c1-7573-4b81-9657-7e277547e2c3 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] 10.222.0.25 "GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064" status: 200 len: 1319 microversion: 2.1 time: 0.313996 May 27 03:45:32.714956 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 428/810] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:45:32 2021] GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064 => generated 1319 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:45:32.780503 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-9ca9279e-7d42-489f-ab78-a3c85f1f6be8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:32.789914 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-9ca9279e-7d42-489f-ab78-a3c85f1f6be8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:32.791447 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-9ca9279e-7d42-489f-ab78-a3c85f1f6be8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:32.792609 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-9ca9279e-7d42-489f-ab78-a3c85f1f6be8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1750 microversion: 2.20 time: 0.225121 May 27 03:45:32.793166 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 383/811] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:45:32 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1750 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:45:33.510258 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-bb6eaec3-80c7-4348-8669-d5f6ef45bc20 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:33.510873 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-bb6eaec3-80c7-4348-8669-d5f6ef45bc20 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:33.518099 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-bb6eaec3-80c7-4348-8669-d5f6ef45bc20 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:33.518550 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-bb6eaec3-80c7-4348-8669-d5f6ef45bc20 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:33.519317 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-bb6eaec3-80c7-4348-8669-d5f6ef45bc20 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:33.519751 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-bb6eaec3-80c7-4348-8669-d5f6ef45bc20 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:33.715762 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-bb6eaec3-80c7-4348-8669-d5f6ef45bc20 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:33.724800 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-bb6eaec3-80c7-4348-8669-d5f6ef45bc20 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1709 microversion: 2.1 time: 0.218197 May 27 03:45:33.725359 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 429/812] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:45:33 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1709 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:45:33.730700 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-2d9ad0c1-2e1a-4388-8dbd-5e872ead5a63 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:33.731330 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-2d9ad0c1-2e1a-4388-8dbd-5e872ead5a63 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] [instance: 365c2ebc-713f-475e-a586-fa68bb6b3064] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:33.739304 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2d9ad0c1-2e1a-4388-8dbd-5e872ead5a63 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:33.739763 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2d9ad0c1-2e1a-4388-8dbd-5e872ead5a63 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:33.740559 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2d9ad0c1-2e1a-4388-8dbd-5e872ead5a63 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:33.740995 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2d9ad0c1-2e1a-4388-8dbd-5e872ead5a63 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:33.811153 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-5bc60b66-1b90-4c2b-a3d1-e9f698b1e94b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:33.811796 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-5bc60b66-1b90-4c2b-a3d1-e9f698b1e94b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:33.819676 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-5bc60b66-1b90-4c2b-a3d1-e9f698b1e94b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:33.825598 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-5bc60b66-1b90-4c2b-a3d1-e9f698b1e94b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:33.826657 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-5bc60b66-1b90-4c2b-a3d1-e9f698b1e94b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:33.828255 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-5bc60b66-1b90-4c2b-a3d1-e9f698b1e94b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:33.941268 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-2d9ad0c1-2e1a-4388-8dbd-5e872ead5a63 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71289d2497de4089bfcdae8474859196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dc5f669f3f483bacc0bf258a11c302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:33.949332 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-2d9ad0c1-2e1a-4388-8dbd-5e872ead5a63 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] 10.222.0.25 "GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064" status: 200 len: 1319 microversion: 2.1 time: 0.222289 May 27 03:45:33.949896 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 384/813] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:45:33 2021] GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064 => generated 1319 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:45:34.020649 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-5bc60b66-1b90-4c2b-a3d1-e9f698b1e94b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:34.030363 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-5bc60b66-1b90-4c2b-a3d1-e9f698b1e94b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:34.031918 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-5bc60b66-1b90-4c2b-a3d1-e9f698b1e94b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:34.033098 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-5bc60b66-1b90-4c2b-a3d1-e9f698b1e94b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1750 microversion: 2.20 time: 0.226124 May 27 03:45:34.033657 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 430/814] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:45:33 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1750 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:45:34.742445 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-8529bd75-3258-4ba8-bd21-597b31328e08 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:34.743091 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-8529bd75-3258-4ba8-bd21-597b31328e08 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:34.750841 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8529bd75-3258-4ba8-bd21-597b31328e08 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:34.751295 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8529bd75-3258-4ba8-bd21-597b31328e08 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:34.752064 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8529bd75-3258-4ba8-bd21-597b31328e08 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:34.752534 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8529bd75-3258-4ba8-bd21-597b31328e08 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:34.950228 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-8529bd75-3258-4ba8-bd21-597b31328e08 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:34.958931 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-8529bd75-3258-4ba8-bd21-597b31328e08 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1709 microversion: 2.1 time: 0.220170 May 27 03:45:34.959505 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 385/815] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:45:34 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1709 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:45:34.965416 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-8e0f21e7-e056-41e8-8369-8a25384303c6 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:34.966039 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-8e0f21e7-e056-41e8-8369-8a25384303c6 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] [instance: 365c2ebc-713f-475e-a586-fa68bb6b3064] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:34.973426 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8e0f21e7-e056-41e8-8369-8a25384303c6 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:34.973878 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8e0f21e7-e056-41e8-8369-8a25384303c6 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:34.974649 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8e0f21e7-e056-41e8-8369-8a25384303c6 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:34.975087 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8e0f21e7-e056-41e8-8369-8a25384303c6 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:35.051776 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-e7192bff-1917-48d9-9302-5ffbf78474ca tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:35.052386 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-e7192bff-1917-48d9-9302-5ffbf78474ca tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:35.059810 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e7192bff-1917-48d9-9302-5ffbf78474ca tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:35.060264 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e7192bff-1917-48d9-9302-5ffbf78474ca tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:35.061635 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e7192bff-1917-48d9-9302-5ffbf78474ca tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:35.062076 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e7192bff-1917-48d9-9302-5ffbf78474ca tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:35.170079 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-8e0f21e7-e056-41e8-8369-8a25384303c6 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71289d2497de4089bfcdae8474859196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dc5f669f3f483bacc0bf258a11c302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:35.178700 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-8e0f21e7-e056-41e8-8369-8a25384303c6 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] 10.222.0.25 "GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064" status: 200 len: 1319 microversion: 2.1 time: 0.216937 May 27 03:45:35.179472 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 431/816] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:45:34 2021] GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064 => generated 1319 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:45:35.257300 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-e7192bff-1917-48d9-9302-5ffbf78474ca tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:35.266302 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-e7192bff-1917-48d9-9302-5ffbf78474ca tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:35.267817 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-e7192bff-1917-48d9-9302-5ffbf78474ca tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:35.268963 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-e7192bff-1917-48d9-9302-5ffbf78474ca tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1750 microversion: 2.20 time: 0.220890 May 27 03:45:35.269510 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 386/817] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:45:35 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1750 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:45:35.975497 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-9610ad45-7679-4a8d-a3bb-b3918062085f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:35.976111 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-9610ad45-7679-4a8d-a3bb-b3918062085f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:35.983240 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9610ad45-7679-4a8d-a3bb-b3918062085f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:35.983693 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9610ad45-7679-4a8d-a3bb-b3918062085f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:35.984485 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9610ad45-7679-4a8d-a3bb-b3918062085f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:35.984931 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9610ad45-7679-4a8d-a3bb-b3918062085f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:36.195300 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-ec19942f-5188-436d-959e-57b1913d97bb tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:36.195834 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-ec19942f-5188-436d-959e-57b1913d97bb tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] [instance: 365c2ebc-713f-475e-a586-fa68bb6b3064] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:36.204176 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ec19942f-5188-436d-959e-57b1913d97bb tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:36.204666 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ec19942f-5188-436d-959e-57b1913d97bb tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:36.205467 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ec19942f-5188-436d-959e-57b1913d97bb tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:36.205908 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ec19942f-5188-436d-959e-57b1913d97bb tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:36.262106 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-9610ad45-7679-4a8d-a3bb-b3918062085f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:36.271478 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-9610ad45-7679-4a8d-a3bb-b3918062085f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1709 microversion: 2.1 time: 0.299607 May 27 03:45:36.272049 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 432/818] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:45:35 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1709 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:45:36.286549 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-af027f25-f587-48f4-8da4-55e77de5f5fd tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:36.287158 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-af027f25-f587-48f4-8da4-55e77de5f5fd tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:36.294671 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-af027f25-f587-48f4-8da4-55e77de5f5fd tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:36.295649 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-af027f25-f587-48f4-8da4-55e77de5f5fd tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:36.296441 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-af027f25-f587-48f4-8da4-55e77de5f5fd tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:36.296891 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-af027f25-f587-48f4-8da4-55e77de5f5fd tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:36.406432 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-ec19942f-5188-436d-959e-57b1913d97bb tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71289d2497de4089bfcdae8474859196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dc5f669f3f483bacc0bf258a11c302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:36.418138 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-ec19942f-5188-436d-959e-57b1913d97bb tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] 10.222.0.25 "GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064" status: 200 len: 1319 microversion: 2.1 time: 0.223808 May 27 03:45:36.418138 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 387/819] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:45:36 2021] GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064 => generated 1319 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:45:36.500038 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-af027f25-f587-48f4-8da4-55e77de5f5fd tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:36.509493 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-af027f25-f587-48f4-8da4-55e77de5f5fd tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:36.511251 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-af027f25-f587-48f4-8da4-55e77de5f5fd tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:36.513212 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-af027f25-f587-48f4-8da4-55e77de5f5fd tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1750 microversion: 2.20 time: 0.229829 May 27 03:45:36.514068 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 433/820] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:45:36 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1750 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:45:37.289605 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-8f138b69-ecd5-4fc0-beb5-e828cee17c93 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:37.290236 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-8f138b69-ecd5-4fc0-beb5-e828cee17c93 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:37.298405 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8f138b69-ecd5-4fc0-beb5-e828cee17c93 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:37.298880 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8f138b69-ecd5-4fc0-beb5-e828cee17c93 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:37.299675 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8f138b69-ecd5-4fc0-beb5-e828cee17c93 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:37.300126 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8f138b69-ecd5-4fc0-beb5-e828cee17c93 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:37.433865 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-d39b4900-05a6-4531-a69f-fa333ffa5512 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:37.434404 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-d39b4900-05a6-4531-a69f-fa333ffa5512 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] [instance: 365c2ebc-713f-475e-a586-fa68bb6b3064] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:37.442226 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d39b4900-05a6-4531-a69f-fa333ffa5512 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:37.442682 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d39b4900-05a6-4531-a69f-fa333ffa5512 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:37.443456 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d39b4900-05a6-4531-a69f-fa333ffa5512 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:37.443897 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d39b4900-05a6-4531-a69f-fa333ffa5512 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:37.644290 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-d39b4900-05a6-4531-a69f-fa333ffa5512 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71289d2497de4089bfcdae8474859196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dc5f669f3f483bacc0bf258a11c302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:37.652955 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-d39b4900-05a6-4531-a69f-fa333ffa5512 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] 10.222.0.25 "GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064" status: 200 len: 1319 microversion: 2.1 time: 0.222893 May 27 03:45:37.653533 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 434/821] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:45:37 2021] GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064 => generated 1319 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:45:37.657907 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-dc12a515-8f4a-49d9-87cc-46b8572ce44c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:37.658540 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-dc12a515-8f4a-49d9-87cc-46b8572ce44c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:37.665760 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-dc12a515-8f4a-49d9-87cc-46b8572ce44c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:37.666223 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-dc12a515-8f4a-49d9-87cc-46b8572ce44c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:37.666991 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-dc12a515-8f4a-49d9-87cc-46b8572ce44c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:37.667431 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-dc12a515-8f4a-49d9-87cc-46b8572ce44c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:37.780185 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-8f138b69-ecd5-4fc0-beb5-e828cee17c93 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:37.789729 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-8f138b69-ecd5-4fc0-beb5-e828cee17c93 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1709 microversion: 2.1 time: 0.504979 May 27 03:45:37.790492 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 388/822] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:45:37 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1709 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:45:37.870057 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-dc12a515-8f4a-49d9-87cc-46b8572ce44c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:37.880151 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-dc12a515-8f4a-49d9-87cc-46b8572ce44c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:37.881709 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-dc12a515-8f4a-49d9-87cc-46b8572ce44c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:37.882856 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-dc12a515-8f4a-49d9-87cc-46b8572ce44c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1752 microversion: 2.20 time: 0.228400 May 27 03:45:37.883418 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 435/823] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:45:37 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1752 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:45:38.669771 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-01b57b5f-5b17-4cbc-9667-910d06f36dab tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:38.670393 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-01b57b5f-5b17-4cbc-9667-910d06f36dab tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] [instance: 365c2ebc-713f-475e-a586-fa68bb6b3064] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:38.677761 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-01b57b5f-5b17-4cbc-9667-910d06f36dab tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:38.678217 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-01b57b5f-5b17-4cbc-9667-910d06f36dab tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:38.678996 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-01b57b5f-5b17-4cbc-9667-910d06f36dab tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:38.679439 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-01b57b5f-5b17-4cbc-9667-910d06f36dab tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:38.807105 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-29ff54bc-0271-4512-843c-25a590ced08e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:38.807662 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-29ff54bc-0271-4512-843c-25a590ced08e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:38.815887 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-29ff54bc-0271-4512-843c-25a590ced08e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:38.816338 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-29ff54bc-0271-4512-843c-25a590ced08e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:38.817145 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-29ff54bc-0271-4512-843c-25a590ced08e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:38.817616 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-29ff54bc-0271-4512-843c-25a590ced08e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:38.891764 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-01b57b5f-5b17-4cbc-9667-910d06f36dab tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71289d2497de4089bfcdae8474859196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dc5f669f3f483bacc0bf258a11c302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:38.900117 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-01b57b5f-5b17-4cbc-9667-910d06f36dab tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] 10.222.0.25 "GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064" status: 200 len: 1319 microversion: 2.1 time: 0.233990 May 27 03:45:38.900728 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 389/824] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:45:38 2021] GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064 => generated 1319 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:45:38.907033 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-418f682b-50e6-43fe-b625-2a16f1cf04b9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:38.907855 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-418f682b-50e6-43fe-b625-2a16f1cf04b9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:38.916631 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-418f682b-50e6-43fe-b625-2a16f1cf04b9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:38.917094 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-418f682b-50e6-43fe-b625-2a16f1cf04b9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:38.917882 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-418f682b-50e6-43fe-b625-2a16f1cf04b9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:38.918320 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-418f682b-50e6-43fe-b625-2a16f1cf04b9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:39.038040 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-29ff54bc-0271-4512-843c-25a590ced08e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:39.046828 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-29ff54bc-0271-4512-843c-25a590ced08e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1709 microversion: 2.1 time: 0.243522 May 27 03:45:39.047397 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 436/825] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:45:38 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1709 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:45:39.114532 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-418f682b-50e6-43fe-b625-2a16f1cf04b9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:39.124267 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-418f682b-50e6-43fe-b625-2a16f1cf04b9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:39.125843 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-418f682b-50e6-43fe-b625-2a16f1cf04b9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:39.126978 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-418f682b-50e6-43fe-b625-2a16f1cf04b9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1808 microversion: 2.20 time: 0.225339 May 27 03:45:39.127544 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 390/826] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:45:38 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1808 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:45:39.917827 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-fbba1515-aaeb-458c-ae17-0970c853d48d tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:39.918358 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-fbba1515-aaeb-458c-ae17-0970c853d48d tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] [instance: 365c2ebc-713f-475e-a586-fa68bb6b3064] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:39.926302 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-fbba1515-aaeb-458c-ae17-0970c853d48d tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:39.927533 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-fbba1515-aaeb-458c-ae17-0970c853d48d tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:39.927533 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-fbba1515-aaeb-458c-ae17-0970c853d48d tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:39.927919 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-fbba1515-aaeb-458c-ae17-0970c853d48d tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:40.063109 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-a0db815f-1da8-4ea7-8e7b-2873c86ac05e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:40.064316 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-a0db815f-1da8-4ea7-8e7b-2873c86ac05e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:40.072280 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a0db815f-1da8-4ea7-8e7b-2873c86ac05e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:40.073026 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a0db815f-1da8-4ea7-8e7b-2873c86ac05e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:40.073824 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a0db815f-1da8-4ea7-8e7b-2873c86ac05e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:40.074272 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a0db815f-1da8-4ea7-8e7b-2873c86ac05e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:40.133435 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-fbba1515-aaeb-458c-ae17-0970c853d48d tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71289d2497de4089bfcdae8474859196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dc5f669f3f483bacc0bf258a11c302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:40.142965 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-fbba1515-aaeb-458c-ae17-0970c853d48d tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] 10.222.0.25 "GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064" status: 200 len: 1319 microversion: 2.1 time: 0.228860 May 27 03:45:40.144231 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 437/827] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:45:39 2021] GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064 => generated 1319 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:45:40.148968 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-a4776cbf-a4fa-4a6d-9562-58f5cae6bc6b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:40.149770 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-a4776cbf-a4fa-4a6d-9562-58f5cae6bc6b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:40.157645 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a4776cbf-a4fa-4a6d-9562-58f5cae6bc6b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:40.158170 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a4776cbf-a4fa-4a6d-9562-58f5cae6bc6b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:40.159006 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a4776cbf-a4fa-4a6d-9562-58f5cae6bc6b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:40.159511 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a4776cbf-a4fa-4a6d-9562-58f5cae6bc6b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:40.355352 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-a4776cbf-a4fa-4a6d-9562-58f5cae6bc6b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:40.364638 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-a4776cbf-a4fa-4a6d-9562-58f5cae6bc6b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:40.366167 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-a4776cbf-a4fa-4a6d-9562-58f5cae6bc6b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:40.367292 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-a4776cbf-a4fa-4a6d-9562-58f5cae6bc6b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1808 microversion: 2.20 time: 0.221984 May 27 03:45:40.367842 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 438/828] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:45:40 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1808 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:45:40.420724 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-a0db815f-1da8-4ea7-8e7b-2873c86ac05e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:40.430017 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-a0db815f-1da8-4ea7-8e7b-2873c86ac05e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1713 microversion: 2.1 time: 0.370715 May 27 03:45:40.435307 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 391/829] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:45:40 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1713 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:45:41.158992 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-51b182fc-e85d-49f4-a493-d61c81a2bc31 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:41.159612 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-51b182fc-e85d-49f4-a493-d61c81a2bc31 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] [instance: 365c2ebc-713f-475e-a586-fa68bb6b3064] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:41.167650 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-51b182fc-e85d-49f4-a493-d61c81a2bc31 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:41.168186 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-51b182fc-e85d-49f4-a493-d61c81a2bc31 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:41.169075 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-51b182fc-e85d-49f4-a493-d61c81a2bc31 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:41.169586 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-51b182fc-e85d-49f4-a493-d61c81a2bc31 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:41.369612 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-51b182fc-e85d-49f4-a493-d61c81a2bc31 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71289d2497de4089bfcdae8474859196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dc5f669f3f483bacc0bf258a11c302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:41.377678 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-51b182fc-e85d-49f4-a493-d61c81a2bc31 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] 10.222.0.25 "GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064" status: 200 len: 1319 microversion: 2.1 time: 0.222357 May 27 03:45:41.378244 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 439/830] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:45:41 2021] GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064 => generated 1319 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:45:41.384904 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-6fd4c974-54a9-49cd-863d-93f61a59c7a1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:41.385554 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-6fd4c974-54a9-49cd-863d-93f61a59c7a1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:41.392821 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6fd4c974-54a9-49cd-863d-93f61a59c7a1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:41.395905 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6fd4c974-54a9-49cd-863d-93f61a59c7a1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:41.395905 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6fd4c974-54a9-49cd-863d-93f61a59c7a1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:41.395905 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6fd4c974-54a9-49cd-863d-93f61a59c7a1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:41.591012 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-6fd4c974-54a9-49cd-863d-93f61a59c7a1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:41.600682 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-6fd4c974-54a9-49cd-863d-93f61a59c7a1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:41.602201 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-6fd4c974-54a9-49cd-863d-93f61a59c7a1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:41.603326 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-6fd4c974-54a9-49cd-863d-93f61a59c7a1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1808 microversion: 2.20 time: 0.222066 May 27 03:45:41.603876 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 392/831] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:45:41 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1808 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:45:42.393727 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-2b7f6b77-7621-4148-8c35-1ba1d513168e tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:42.394304 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-2b7f6b77-7621-4148-8c35-1ba1d513168e tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] [instance: 365c2ebc-713f-475e-a586-fa68bb6b3064] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:42.401664 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-2b7f6b77-7621-4148-8c35-1ba1d513168e tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:42.404497 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-2b7f6b77-7621-4148-8c35-1ba1d513168e tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:42.404497 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-2b7f6b77-7621-4148-8c35-1ba1d513168e tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:42.404497 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-2b7f6b77-7621-4148-8c35-1ba1d513168e tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:42.620262 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-2b7f6b77-7621-4148-8c35-1ba1d513168e tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71289d2497de4089bfcdae8474859196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dc5f669f3f483bacc0bf258a11c302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:42.621918 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-d3b1eaf8-a8c7-4a53-8bf9-ddc144a6e1b5 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:42.622544 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-d3b1eaf8-a8c7-4a53-8bf9-ddc144a6e1b5 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:42.629956 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-2b7f6b77-7621-4148-8c35-1ba1d513168e tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] 10.222.0.25 "GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064" status: 200 len: 1319 microversion: 2.1 time: 0.239958 May 27 03:45:42.630616 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 440/832] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:45:42 2021] GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064 => generated 1319 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:45:42.630867 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d3b1eaf8-a8c7-4a53-8bf9-ddc144a6e1b5 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:42.631325 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d3b1eaf8-a8c7-4a53-8bf9-ddc144a6e1b5 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:42.632123 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d3b1eaf8-a8c7-4a53-8bf9-ddc144a6e1b5 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:42.632599 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d3b1eaf8-a8c7-4a53-8bf9-ddc144a6e1b5 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:42.834378 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-d3b1eaf8-a8c7-4a53-8bf9-ddc144a6e1b5 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:42.844561 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-d3b1eaf8-a8c7-4a53-8bf9-ddc144a6e1b5 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:42.846173 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-d3b1eaf8-a8c7-4a53-8bf9-ddc144a6e1b5 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:42.847344 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-d3b1eaf8-a8c7-4a53-8bf9-ddc144a6e1b5 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1808 microversion: 2.20 time: 0.229246 May 27 03:45:42.847906 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 393/833] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:45:42 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1808 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:45:43.646869 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-9b82d1aa-9d05-42d7-a8a1-e4c799b89a8f tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:43.647504 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-9b82d1aa-9d05-42d7-a8a1-e4c799b89a8f tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] [instance: 365c2ebc-713f-475e-a586-fa68bb6b3064] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:43.655663 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9b82d1aa-9d05-42d7-a8a1-e4c799b89a8f tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:43.656357 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9b82d1aa-9d05-42d7-a8a1-e4c799b89a8f tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:43.657153 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9b82d1aa-9d05-42d7-a8a1-e4c799b89a8f tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:43.657591 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9b82d1aa-9d05-42d7-a8a1-e4c799b89a8f tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:43.855211 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-9b82d1aa-9d05-42d7-a8a1-e4c799b89a8f tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71289d2497de4089bfcdae8474859196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dc5f669f3f483bacc0bf258a11c302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:43.863365 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-9b82d1aa-9d05-42d7-a8a1-e4c799b89a8f tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] 10.222.0.25 "GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064" status: 200 len: 1319 microversion: 2.1 time: 0.220175 May 27 03:45:43.863927 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 441/834] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:45:43 2021] GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064 => generated 1319 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:45:43.865879 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-ac0227c6-6277-4db3-8a38-81bf02254a80 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:43.866495 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-ac0227c6-6277-4db3-8a38-81bf02254a80 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:43.873622 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ac0227c6-6277-4db3-8a38-81bf02254a80 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:43.874071 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ac0227c6-6277-4db3-8a38-81bf02254a80 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:43.874875 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ac0227c6-6277-4db3-8a38-81bf02254a80 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:43.875284 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ac0227c6-6277-4db3-8a38-81bf02254a80 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:44.068882 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-ac0227c6-6277-4db3-8a38-81bf02254a80 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:44.079450 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-ac0227c6-6277-4db3-8a38-81bf02254a80 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:44.081054 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-ac0227c6-6277-4db3-8a38-81bf02254a80 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:44.082239 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-ac0227c6-6277-4db3-8a38-81bf02254a80 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1808 microversion: 2.20 time: 0.220073 May 27 03:45:44.082806 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 394/835] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:45:43 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1808 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:45:44.880706 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-ff7deedb-40af-4e30-b9d8-2f9f9fd8590e tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:44.881506 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-ff7deedb-40af-4e30-b9d8-2f9f9fd8590e tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] [instance: 365c2ebc-713f-475e-a586-fa68bb6b3064] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:44.892553 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ff7deedb-40af-4e30-b9d8-2f9f9fd8590e tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:44.893002 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ff7deedb-40af-4e30-b9d8-2f9f9fd8590e tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:44.893786 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ff7deedb-40af-4e30-b9d8-2f9f9fd8590e tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:44.894223 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ff7deedb-40af-4e30-b9d8-2f9f9fd8590e tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:45.100936 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-50c28b99-c3a7-4fb3-a406-f19fa9805ab0 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:45.101554 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-50c28b99-c3a7-4fb3-a406-f19fa9805ab0 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:45.102353 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-ff7deedb-40af-4e30-b9d8-2f9f9fd8590e tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71289d2497de4089bfcdae8474859196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dc5f669f3f483bacc0bf258a11c302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:45.110265 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-50c28b99-c3a7-4fb3-a406-f19fa9805ab0 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:45.110733 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-50c28b99-c3a7-4fb3-a406-f19fa9805ab0 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:45.111542 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-50c28b99-c3a7-4fb3-a406-f19fa9805ab0 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:45.111994 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-50c28b99-c3a7-4fb3-a406-f19fa9805ab0 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:45.112188 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-ff7deedb-40af-4e30-b9d8-2f9f9fd8590e tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] 10.222.0.25 "GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064" status: 200 len: 1319 microversion: 2.1 time: 0.235343 May 27 03:45:45.112807 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 442/836] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:45:44 2021] GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064 => generated 1319 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:45:45.327324 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-50c28b99-c3a7-4fb3-a406-f19fa9805ab0 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:45.336496 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-50c28b99-c3a7-4fb3-a406-f19fa9805ab0 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:45.338024 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-50c28b99-c3a7-4fb3-a406-f19fa9805ab0 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:45.339160 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-50c28b99-c3a7-4fb3-a406-f19fa9805ab0 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1808 microversion: 2.20 time: 0.242073 May 27 03:45:45.339711 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 395/837] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:45:45 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1808 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:45:46.129359 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-12a62211-39ac-4684-a4bc-607a8e1f09fd tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:46.129895 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-12a62211-39ac-4684-a4bc-607a8e1f09fd tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] [instance: 365c2ebc-713f-475e-a586-fa68bb6b3064] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:46.137295 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-12a62211-39ac-4684-a4bc-607a8e1f09fd tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:46.137779 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-12a62211-39ac-4684-a4bc-607a8e1f09fd tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:46.138555 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-12a62211-39ac-4684-a4bc-607a8e1f09fd tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:46.138992 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-12a62211-39ac-4684-a4bc-607a8e1f09fd tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:46.332497 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-12a62211-39ac-4684-a4bc-607a8e1f09fd tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71289d2497de4089bfcdae8474859196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dc5f669f3f483bacc0bf258a11c302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:46.341472 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-12a62211-39ac-4684-a4bc-607a8e1f09fd tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] 10.222.0.25 "GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064" status: 200 len: 1319 microversion: 2.1 time: 0.215750 May 27 03:45:46.342096 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 443/838] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:45:46 2021] GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064 => generated 1319 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:45:46.358422 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-a454785d-d900-4bd7-82a3-c78a34e651e8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:46.359142 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-a454785d-d900-4bd7-82a3-c78a34e651e8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:46.366646 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a454785d-d900-4bd7-82a3-c78a34e651e8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:46.367233 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a454785d-d900-4bd7-82a3-c78a34e651e8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:46.368042 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a454785d-d900-4bd7-82a3-c78a34e651e8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:46.368522 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a454785d-d900-4bd7-82a3-c78a34e651e8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:46.566034 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-a454785d-d900-4bd7-82a3-c78a34e651e8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:46.575209 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-a454785d-d900-4bd7-82a3-c78a34e651e8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:46.576834 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-a454785d-d900-4bd7-82a3-c78a34e651e8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:46.577979 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-a454785d-d900-4bd7-82a3-c78a34e651e8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1808 microversion: 2.20 time: 0.223871 May 27 03:45:46.578537 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 396/839] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:45:46 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1808 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:45:47.357874 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-12824376-cb69-4913-a393-b65a864ca3bc tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:47.358482 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-12824376-cb69-4913-a393-b65a864ca3bc tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] [instance: 365c2ebc-713f-475e-a586-fa68bb6b3064] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:47.365871 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-12824376-cb69-4913-a393-b65a864ca3bc tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:47.366318 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-12824376-cb69-4913-a393-b65a864ca3bc tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:47.367150 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-12824376-cb69-4913-a393-b65a864ca3bc tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:47.367671 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-12824376-cb69-4913-a393-b65a864ca3bc tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:47.587045 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-12824376-cb69-4913-a393-b65a864ca3bc tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71289d2497de4089bfcdae8474859196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dc5f669f3f483bacc0bf258a11c302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:47.594931 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-6a531565-95a4-4d10-a2cb-0ced1a76f6fa tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:47.595680 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-6a531565-95a4-4d10-a2cb-0ced1a76f6fa tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:47.596269 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-12824376-cb69-4913-a393-b65a864ca3bc tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] 10.222.0.25 "GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064" status: 200 len: 1319 microversion: 2.1 time: 0.241958 May 27 03:45:47.596957 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 444/840] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:45:47 2021] GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064 => generated 1319 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:45:47.603206 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6a531565-95a4-4d10-a2cb-0ced1a76f6fa tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:47.604641 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6a531565-95a4-4d10-a2cb-0ced1a76f6fa tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:47.604641 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6a531565-95a4-4d10-a2cb-0ced1a76f6fa tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:47.604981 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6a531565-95a4-4d10-a2cb-0ced1a76f6fa tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:47.821497 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-6a531565-95a4-4d10-a2cb-0ced1a76f6fa tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:47.830792 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-6a531565-95a4-4d10-a2cb-0ced1a76f6fa tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:47.832316 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-6a531565-95a4-4d10-a2cb-0ced1a76f6fa tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:47.833482 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-6a531565-95a4-4d10-a2cb-0ced1a76f6fa tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1808 microversion: 2.20 time: 0.242355 May 27 03:45:47.834034 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 397/841] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:45:47 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1808 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:45:48.619920 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-dfd18e11-1f32-4a8e-afaa-4479cdf6ce6d tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:48.620544 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-dfd18e11-1f32-4a8e-afaa-4479cdf6ce6d tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] [instance: 365c2ebc-713f-475e-a586-fa68bb6b3064] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:48.627764 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-dfd18e11-1f32-4a8e-afaa-4479cdf6ce6d tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:48.628209 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-dfd18e11-1f32-4a8e-afaa-4479cdf6ce6d tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:48.629009 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-dfd18e11-1f32-4a8e-afaa-4479cdf6ce6d tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:48.629508 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-dfd18e11-1f32-4a8e-afaa-4479cdf6ce6d tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:48.833589 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-dfd18e11-1f32-4a8e-afaa-4479cdf6ce6d tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71289d2497de4089bfcdae8474859196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dc5f669f3f483bacc0bf258a11c302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:48.841916 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-dfd18e11-1f32-4a8e-afaa-4479cdf6ce6d tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] 10.222.0.25 "GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064" status: 200 len: 1319 microversion: 2.1 time: 0.225699 May 27 03:45:48.842490 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 445/842] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:45:48 2021] GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064 => generated 1319 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:45:48.852916 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-02a91b54-168d-49d2-9891-b0180db5e39c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:48.853723 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-02a91b54-168d-49d2-9891-b0180db5e39c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:48.861396 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-02a91b54-168d-49d2-9891-b0180db5e39c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:48.861958 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-02a91b54-168d-49d2-9891-b0180db5e39c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:48.862825 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-02a91b54-168d-49d2-9891-b0180db5e39c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:48.863349 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-02a91b54-168d-49d2-9891-b0180db5e39c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:49.066615 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-02a91b54-168d-49d2-9891-b0180db5e39c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:49.077246 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-02a91b54-168d-49d2-9891-b0180db5e39c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:49.078806 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-02a91b54-168d-49d2-9891-b0180db5e39c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:49.079963 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-02a91b54-168d-49d2-9891-b0180db5e39c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1808 microversion: 2.20 time: 0.230911 May 27 03:45:49.080556 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 398/843] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:45:48 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1808 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:45:49.859184 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-4c8f642d-ddd8-4a4b-937c-3a80cdf9c1c2 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:49.859793 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-4c8f642d-ddd8-4a4b-937c-3a80cdf9c1c2 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] [instance: 365c2ebc-713f-475e-a586-fa68bb6b3064] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:49.866913 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4c8f642d-ddd8-4a4b-937c-3a80cdf9c1c2 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:49.867358 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4c8f642d-ddd8-4a4b-937c-3a80cdf9c1c2 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:49.868120 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4c8f642d-ddd8-4a4b-937c-3a80cdf9c1c2 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:49.868594 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4c8f642d-ddd8-4a4b-937c-3a80cdf9c1c2 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:50.079556 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-4c8f642d-ddd8-4a4b-937c-3a80cdf9c1c2 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71289d2497de4089bfcdae8474859196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dc5f669f3f483bacc0bf258a11c302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:50.089211 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-4c8f642d-ddd8-4a4b-937c-3a80cdf9c1c2 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] 10.222.0.25 "GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064" status: 200 len: 1319 microversion: 2.1 time: 0.234131 May 27 03:45:50.089899 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 446/844] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:45:49 2021] GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064 => generated 1319 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:45:50.098189 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-b9619cda-86bc-41ee-8784-48104d3c8f82 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:50.098811 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-b9619cda-86bc-41ee-8784-48104d3c8f82 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:50.109121 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b9619cda-86bc-41ee-8784-48104d3c8f82 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:50.109600 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b9619cda-86bc-41ee-8784-48104d3c8f82 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:50.110386 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b9619cda-86bc-41ee-8784-48104d3c8f82 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:50.110813 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b9619cda-86bc-41ee-8784-48104d3c8f82 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:50.336525 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-b9619cda-86bc-41ee-8784-48104d3c8f82 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:50.347515 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-b9619cda-86bc-41ee-8784-48104d3c8f82 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:50.350765 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-b9619cda-86bc-41ee-8784-48104d3c8f82 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:50.350765 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-b9619cda-86bc-41ee-8784-48104d3c8f82 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1808 microversion: 2.20 time: 0.255952 May 27 03:45:50.362265 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 399/845] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:45:50 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1808 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:45:51.105059 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-22516b5f-e7cf-4335-8974-5cf56557d3b9 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:51.105616 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-22516b5f-e7cf-4335-8974-5cf56557d3b9 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] [instance: 365c2ebc-713f-475e-a586-fa68bb6b3064] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:51.112848 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-22516b5f-e7cf-4335-8974-5cf56557d3b9 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:51.113302 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-22516b5f-e7cf-4335-8974-5cf56557d3b9 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:51.114076 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-22516b5f-e7cf-4335-8974-5cf56557d3b9 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:51.114532 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-22516b5f-e7cf-4335-8974-5cf56557d3b9 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:51.313444 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-22516b5f-e7cf-4335-8974-5cf56557d3b9 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71289d2497de4089bfcdae8474859196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dc5f669f3f483bacc0bf258a11c302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:51.322103 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-22516b5f-e7cf-4335-8974-5cf56557d3b9 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] 10.222.0.25 "GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064" status: 200 len: 1319 microversion: 2.1 time: 0.220846 May 27 03:45:51.322764 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 447/846] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:45:51 2021] GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064 => generated 1319 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:45:51.369638 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-c7557d40-ab78-4942-8e3f-b7119d77576a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:51.370128 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-c7557d40-ab78-4942-8e3f-b7119d77576a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:51.382956 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c7557d40-ab78-4942-8e3f-b7119d77576a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:51.382956 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c7557d40-ab78-4942-8e3f-b7119d77576a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:51.382956 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c7557d40-ab78-4942-8e3f-b7119d77576a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:51.382956 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c7557d40-ab78-4942-8e3f-b7119d77576a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:51.539472 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [req-6b0afc3f-6756-4653-8331-4eb3dd1661a3 req-92bad83b-282b-4b17-97d4-5315db349bd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "365c2ebc-713f-475e-a586-fa68bb6b3064", "name": "network-vif-plugged", "status": "completed", "tag": "490a8b44-4014-4b14-b088-dca46edd2c29"}]} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:45:51.541203 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:45:51.541203 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: warnings.warn(msg) May 27 03:45:51.550739 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-6b0afc3f-6756-4653-8331-4eb3dd1661a3 req-92bad83b-282b-4b17-97d4-5315db349bd6 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:51.551195 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-6b0afc3f-6756-4653-8331-4eb3dd1661a3 req-92bad83b-282b-4b17-97d4-5315db349bd6 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:51.568577 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.compute.server_external_events [req-6b0afc3f-6756-4653-8331-4eb3dd1661a3 req-92bad83b-282b-4b17-97d4-5315db349bd6 service nova] Creating event network-vif-plugged:490a8b44-4014-4b14-b088-dca46edd2c29 for instance 365c2ebc-713f-475e-a586-fa68bb6b3064 on hv-cinder-79326 May 27 03:45:51.573868 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [req-6b0afc3f-6756-4653-8331-4eb3dd1661a3 req-92bad83b-282b-4b17-97d4-5315db349bd6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038323 May 27 03:45:51.574837 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 448/847] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:45:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:45:51.698221 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-c7557d40-ab78-4942-8e3f-b7119d77576a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:51.708519 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-c7557d40-ab78-4942-8e3f-b7119d77576a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:51.710083 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-c7557d40-ab78-4942-8e3f-b7119d77576a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:51.711232 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-c7557d40-ab78-4942-8e3f-b7119d77576a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1808 microversion: 2.20 time: 0.345564 May 27 03:45:51.711995 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 400/848] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:45:51 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1808 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:45:52.339447 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-0f203758-f5b8-41b3-af5e-99f2e1737b8a tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:52.340143 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-0f203758-f5b8-41b3-af5e-99f2e1737b8a tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] [instance: 365c2ebc-713f-475e-a586-fa68bb6b3064] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:52.348703 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0f203758-f5b8-41b3-af5e-99f2e1737b8a tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:52.349159 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0f203758-f5b8-41b3-af5e-99f2e1737b8a tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:52.349933 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0f203758-f5b8-41b3-af5e-99f2e1737b8a tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:52.350369 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0f203758-f5b8-41b3-af5e-99f2e1737b8a tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:52.598079 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-0f203758-f5b8-41b3-af5e-99f2e1737b8a tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71289d2497de4089bfcdae8474859196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dc5f669f3f483bacc0bf258a11c302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:52.606180 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-0f203758-f5b8-41b3-af5e-99f2e1737b8a tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] 10.222.0.25 "GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064" status: 200 len: 1319 microversion: 2.1 time: 0.270864 May 27 03:45:52.606742 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 449/849] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:45:52 2021] GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064 => generated 1319 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:45:52.729949 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-3e767570-de42-4ec2-b00f-0bebf6183d4b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:52.730571 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-3e767570-de42-4ec2-b00f-0bebf6183d4b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:52.737784 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-3e767570-de42-4ec2-b00f-0bebf6183d4b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:52.738246 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-3e767570-de42-4ec2-b00f-0bebf6183d4b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:52.739020 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-3e767570-de42-4ec2-b00f-0bebf6183d4b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:52.739466 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-3e767570-de42-4ec2-b00f-0bebf6183d4b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:53.014783 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-3e767570-de42-4ec2-b00f-0bebf6183d4b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:53.023757 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-3e767570-de42-4ec2-b00f-0bebf6183d4b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:53.025326 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-3e767570-de42-4ec2-b00f-0bebf6183d4b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:53.026462 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-3e767570-de42-4ec2-b00f-0bebf6183d4b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1808 microversion: 2.20 time: 0.300209 May 27 03:45:53.027017 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 401/850] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:45:52 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1808 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:45:53.622646 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-8edf1704-2b95-4709-9109-85e8fe69e2a7 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:53.623186 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-8edf1704-2b95-4709-9109-85e8fe69e2a7 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] [instance: 365c2ebc-713f-475e-a586-fa68bb6b3064] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:53.630391 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8edf1704-2b95-4709-9109-85e8fe69e2a7 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:53.630842 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8edf1704-2b95-4709-9109-85e8fe69e2a7 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:53.631606 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8edf1704-2b95-4709-9109-85e8fe69e2a7 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:53.632041 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8edf1704-2b95-4709-9109-85e8fe69e2a7 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:53.826131 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-8edf1704-2b95-4709-9109-85e8fe69e2a7 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71289d2497de4089bfcdae8474859196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dc5f669f3f483bacc0bf258a11c302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:53.834347 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-8edf1704-2b95-4709-9109-85e8fe69e2a7 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] 10.222.0.25 "GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064" status: 200 len: 1319 microversion: 2.1 time: 0.215456 May 27 03:45:53.834910 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 450/851] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:45:53 2021] GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064 => generated 1319 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:45:54.043692 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-96967298-c4ca-4f5b-972e-e5fd2d0c6986 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:54.044309 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-96967298-c4ca-4f5b-972e-e5fd2d0c6986 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:54.051592 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-96967298-c4ca-4f5b-972e-e5fd2d0c6986 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:54.052046 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-96967298-c4ca-4f5b-972e-e5fd2d0c6986 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:54.052886 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-96967298-c4ca-4f5b-972e-e5fd2d0c6986 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:54.053321 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-96967298-c4ca-4f5b-972e-e5fd2d0c6986 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:54.220283 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 03:45:54.221517 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: Thu May 27 03:45:54 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 (ip 10.222.0.25) !!! May 27 03:45:54.248104 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-96967298-c4ca-4f5b-972e-e5fd2d0c6986 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:54.257858 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-96967298-c4ca-4f5b-972e-e5fd2d0c6986 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:54.259389 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-96967298-c4ca-4f5b-972e-e5fd2d0c6986 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:54.260572 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-96967298-c4ca-4f5b-972e-e5fd2d0c6986 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1808 microversion: 2.20 time: 0.220537 May 27 03:45:54.261132 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 402/852] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:45:54 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1808 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:45:54.850794 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-4ce4b82c-81f1-47a4-9f36-fdc42610678f tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:54.851416 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-4ce4b82c-81f1-47a4-9f36-fdc42610678f tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] [instance: 365c2ebc-713f-475e-a586-fa68bb6b3064] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:54.859364 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4ce4b82c-81f1-47a4-9f36-fdc42610678f tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:54.859822 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4ce4b82c-81f1-47a4-9f36-fdc42610678f tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:54.860643 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4ce4b82c-81f1-47a4-9f36-fdc42610678f tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:54.861090 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4ce4b82c-81f1-47a4-9f36-fdc42610678f tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:55.051954 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-4ce4b82c-81f1-47a4-9f36-fdc42610678f tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71289d2497de4089bfcdae8474859196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dc5f669f3f483bacc0bf258a11c302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:55.060049 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-4ce4b82c-81f1-47a4-9f36-fdc42610678f tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] 10.222.0.25 "GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064" status: 200 len: 1319 microversion: 2.1 time: 0.212971 May 27 03:45:55.060644 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 451/853] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:45:54 2021] GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064 => generated 1319 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:45:55.278810 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-9df8aa33-b142-4eef-98cc-a3fbdfd43a1c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:55.279428 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-9df8aa33-b142-4eef-98cc-a3fbdfd43a1c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:55.287506 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-9df8aa33-b142-4eef-98cc-a3fbdfd43a1c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:55.287964 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-9df8aa33-b142-4eef-98cc-a3fbdfd43a1c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:55.288768 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-9df8aa33-b142-4eef-98cc-a3fbdfd43a1c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:55.289209 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-9df8aa33-b142-4eef-98cc-a3fbdfd43a1c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:55.480115 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-9df8aa33-b142-4eef-98cc-a3fbdfd43a1c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:55.489309 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-9df8aa33-b142-4eef-98cc-a3fbdfd43a1c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:55.490968 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-9df8aa33-b142-4eef-98cc-a3fbdfd43a1c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:55.492683 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-9df8aa33-b142-4eef-98cc-a3fbdfd43a1c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1808 microversion: 2.20 time: 0.217173 May 27 03:45:55.492879 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 403/854] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:45:55 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1808 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:45:56.076689 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-95e1c25b-3b39-4178-ab7b-04ba2e16e093 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:56.077875 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-95e1c25b-3b39-4178-ab7b-04ba2e16e093 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] [instance: 365c2ebc-713f-475e-a586-fa68bb6b3064] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:56.085571 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-95e1c25b-3b39-4178-ab7b-04ba2e16e093 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:56.086032 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-95e1c25b-3b39-4178-ab7b-04ba2e16e093 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:56.086824 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-95e1c25b-3b39-4178-ab7b-04ba2e16e093 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:56.087446 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-95e1c25b-3b39-4178-ab7b-04ba2e16e093 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:56.372245 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-95e1c25b-3b39-4178-ab7b-04ba2e16e093 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71289d2497de4089bfcdae8474859196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dc5f669f3f483bacc0bf258a11c302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:56.380586 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-95e1c25b-3b39-4178-ab7b-04ba2e16e093 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] 10.222.0.25 "GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064" status: 200 len: 1319 microversion: 2.1 time: 0.307787 May 27 03:45:56.381354 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 452/855] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:45:56 2021] GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064 => generated 1319 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:45:56.510951 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-d9adf583-8d53-4dde-8a0d-87e25b1437d8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:56.511554 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-d9adf583-8d53-4dde-8a0d-87e25b1437d8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:56.518809 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d9adf583-8d53-4dde-8a0d-87e25b1437d8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:56.519265 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d9adf583-8d53-4dde-8a0d-87e25b1437d8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:56.520033 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d9adf583-8d53-4dde-8a0d-87e25b1437d8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:56.520504 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d9adf583-8d53-4dde-8a0d-87e25b1437d8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:56.721294 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-d9adf583-8d53-4dde-8a0d-87e25b1437d8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:56.730443 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-d9adf583-8d53-4dde-8a0d-87e25b1437d8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:56.732087 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-d9adf583-8d53-4dde-8a0d-87e25b1437d8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:56.733245 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-d9adf583-8d53-4dde-8a0d-87e25b1437d8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1808 microversion: 2.20 time: 0.225999 May 27 03:45:56.733802 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 404/856] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:45:56 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1808 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:45:57.397373 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-be7fcd04-62a6-4005-9101-be92b866056b tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:57.398774 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-be7fcd04-62a6-4005-9101-be92b866056b tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] [instance: 365c2ebc-713f-475e-a586-fa68bb6b3064] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:57.406639 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-be7fcd04-62a6-4005-9101-be92b866056b tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:57.407096 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-be7fcd04-62a6-4005-9101-be92b866056b tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:57.407883 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-be7fcd04-62a6-4005-9101-be92b866056b tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:57.408325 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-be7fcd04-62a6-4005-9101-be92b866056b tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:57.614968 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-be7fcd04-62a6-4005-9101-be92b866056b tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71289d2497de4089bfcdae8474859196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dc5f669f3f483bacc0bf258a11c302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:57.624191 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-be7fcd04-62a6-4005-9101-be92b866056b tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] 10.222.0.25 "GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064" status: 200 len: 1319 microversion: 2.1 time: 0.230522 May 27 03:45:57.625595 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 453/857] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:45:57 2021] GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064 => generated 1319 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:45:57.751080 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-0914b9da-fe21-409f-9300-b6ea9c5b8f9e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:57.751709 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-0914b9da-fe21-409f-9300-b6ea9c5b8f9e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:57.759010 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-0914b9da-fe21-409f-9300-b6ea9c5b8f9e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:57.759465 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-0914b9da-fe21-409f-9300-b6ea9c5b8f9e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:57.760239 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-0914b9da-fe21-409f-9300-b6ea9c5b8f9e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:57.760742 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-0914b9da-fe21-409f-9300-b6ea9c5b8f9e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:57.991946 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-0914b9da-fe21-409f-9300-b6ea9c5b8f9e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:58.001241 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-0914b9da-fe21-409f-9300-b6ea9c5b8f9e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:58.002767 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-0914b9da-fe21-409f-9300-b6ea9c5b8f9e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:58.003898 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-0914b9da-fe21-409f-9300-b6ea9c5b8f9e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1808 microversion: 2.20 time: 0.256606 May 27 03:45:58.004468 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 405/858] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:45:57 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1808 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:45:58.642631 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-949b745d-afb8-4b31-ad63-32a13a139442 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:58.643232 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-949b745d-afb8-4b31-ad63-32a13a139442 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] [instance: 365c2ebc-713f-475e-a586-fa68bb6b3064] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:58.650327 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-949b745d-afb8-4b31-ad63-32a13a139442 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:58.650773 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-949b745d-afb8-4b31-ad63-32a13a139442 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:58.651570 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-949b745d-afb8-4b31-ad63-32a13a139442 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:58.652000 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-949b745d-afb8-4b31-ad63-32a13a139442 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:58.845964 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-949b745d-afb8-4b31-ad63-32a13a139442 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71289d2497de4089bfcdae8474859196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dc5f669f3f483bacc0bf258a11c302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:58.854300 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-949b745d-afb8-4b31-ad63-32a13a139442 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] 10.222.0.25 "GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064" status: 200 len: 1319 microversion: 2.1 time: 0.216041 May 27 03:45:58.854880 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 454/859] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:45:58 2021] GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064 => generated 1319 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:45:59.021536 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-7d6c7268-5522-48ba-8973-2201468b4212 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:59.022149 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-7d6c7268-5522-48ba-8973-2201468b4212 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:59.029451 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-7d6c7268-5522-48ba-8973-2201468b4212 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:59.029895 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-7d6c7268-5522-48ba-8973-2201468b4212 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:59.030659 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-7d6c7268-5522-48ba-8973-2201468b4212 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:59.031088 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-7d6c7268-5522-48ba-8973-2201468b4212 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:59.220735 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-7d6c7268-5522-48ba-8973-2201468b4212 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:59.229827 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-7d6c7268-5522-48ba-8973-2201468b4212 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:59.231354 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-7d6c7268-5522-48ba-8973-2201468b4212 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:45:59.232512 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-7d6c7268-5522-48ba-8973-2201468b4212 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1808 microversion: 2.20 time: 0.214738 May 27 03:45:59.233065 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 406/860] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:45:59 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1808 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:45:59.871435 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-b1f96aa6-a3dc-4194-a1cc-d8592dacd04a tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:45:59.872068 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-b1f96aa6-a3dc-4194-a1cc-d8592dacd04a tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] [instance: 365c2ebc-713f-475e-a586-fa68bb6b3064] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:45:59.881274 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b1f96aa6-a3dc-4194-a1cc-d8592dacd04a tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:59.881748 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b1f96aa6-a3dc-4194-a1cc-d8592dacd04a tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:45:59.882769 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b1f96aa6-a3dc-4194-a1cc-d8592dacd04a tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:45:59.882984 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b1f96aa6-a3dc-4194-a1cc-d8592dacd04a tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:46:00.100840 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-b1f96aa6-a3dc-4194-a1cc-d8592dacd04a tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71289d2497de4089bfcdae8474859196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dc5f669f3f483bacc0bf258a11c302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:00.110176 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-b1f96aa6-a3dc-4194-a1cc-d8592dacd04a tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] 10.222.0.25 "GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064" status: 200 len: 1319 microversion: 2.1 time: 0.242315 May 27 03:46:00.110723 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 455/861] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:45:59 2021] GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064 => generated 1319 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:46:00.252066 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-aaecbeba-804c-4322-961b-e653d4c852ef tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:46:00.253019 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-aaecbeba-804c-4322-961b-e653d4c852ef tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:46:00.263119 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-aaecbeba-804c-4322-961b-e653d4c852ef tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:46:00.263574 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-aaecbeba-804c-4322-961b-e653d4c852ef tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:46:00.264361 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-aaecbeba-804c-4322-961b-e653d4c852ef tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:46:00.265318 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-aaecbeba-804c-4322-961b-e653d4c852ef tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:46:00.473953 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-aaecbeba-804c-4322-961b-e653d4c852ef tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:00.483167 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-aaecbeba-804c-4322-961b-e653d4c852ef tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:00.484872 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-aaecbeba-804c-4322-961b-e653d4c852ef tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:00.486199 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-aaecbeba-804c-4322-961b-e653d4c852ef tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1808 microversion: 2.20 time: 0.238235 May 27 03:46:00.486760 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 407/862] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:46:00 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1808 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:46:01.126241 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-62a5e4df-3f46-4bb2-83e0-bb4f0fd8b5ad tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:46:01.126804 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-62a5e4df-3f46-4bb2-83e0-bb4f0fd8b5ad tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] [instance: 365c2ebc-713f-475e-a586-fa68bb6b3064] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:46:01.134051 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-62a5e4df-3f46-4bb2-83e0-bb4f0fd8b5ad tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:46:01.134494 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-62a5e4df-3f46-4bb2-83e0-bb4f0fd8b5ad tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:46:01.135255 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-62a5e4df-3f46-4bb2-83e0-bb4f0fd8b5ad tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:46:01.135688 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-62a5e4df-3f46-4bb2-83e0-bb4f0fd8b5ad tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:46:01.325813 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-62a5e4df-3f46-4bb2-83e0-bb4f0fd8b5ad tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71289d2497de4089bfcdae8474859196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dc5f669f3f483bacc0bf258a11c302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:01.334274 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-62a5e4df-3f46-4bb2-83e0-bb4f0fd8b5ad tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] 10.222.0.25 "GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064" status: 200 len: 1319 microversion: 2.1 time: 0.211823 May 27 03:46:01.334835 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 456/863] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:46:01 2021] GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064 => generated 1319 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:46:01.505615 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-93d5f7c2-68ee-42bb-ab47-71db177b354b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:46:01.506230 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-93d5f7c2-68ee-42bb-ab47-71db177b354b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:46:01.513619 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-93d5f7c2-68ee-42bb-ab47-71db177b354b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:46:01.514076 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-93d5f7c2-68ee-42bb-ab47-71db177b354b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:46:01.515459 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-93d5f7c2-68ee-42bb-ab47-71db177b354b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:46:01.515921 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-93d5f7c2-68ee-42bb-ab47-71db177b354b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:46:01.704843 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-93d5f7c2-68ee-42bb-ab47-71db177b354b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:01.714103 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-93d5f7c2-68ee-42bb-ab47-71db177b354b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:01.715611 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-93d5f7c2-68ee-42bb-ab47-71db177b354b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:01.716783 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-93d5f7c2-68ee-42bb-ab47-71db177b354b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1808 microversion: 2.20 time: 0.214975 May 27 03:46:01.717348 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 408/864] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:46:01 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1808 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:46:02.351237 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-214f245e-2856-4837-bf9d-ff3c9a9f912f tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:46:02.351865 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-214f245e-2856-4837-bf9d-ff3c9a9f912f tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] [instance: 365c2ebc-713f-475e-a586-fa68bb6b3064] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:46:02.359937 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-214f245e-2856-4837-bf9d-ff3c9a9f912f tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:46:02.360381 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-214f245e-2856-4837-bf9d-ff3c9a9f912f tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:46:02.361238 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-214f245e-2856-4837-bf9d-ff3c9a9f912f tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:46:02.361669 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-214f245e-2856-4837-bf9d-ff3c9a9f912f tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:46:02.561888 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-214f245e-2856-4837-bf9d-ff3c9a9f912f tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71289d2497de4089bfcdae8474859196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dc5f669f3f483bacc0bf258a11c302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:02.569982 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-214f245e-2856-4837-bf9d-ff3c9a9f912f tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] 10.222.0.25 "GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064" status: 200 len: 1319 microversion: 2.1 time: 0.222412 May 27 03:46:02.570544 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 457/865] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:46:02 2021] GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064 => generated 1319 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:46:02.734963 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-1b48ab0c-ef2a-43de-b063-aac99aeeb1f9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:46:02.735518 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-1b48ab0c-ef2a-43de-b063-aac99aeeb1f9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:46:02.742778 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1b48ab0c-ef2a-43de-b063-aac99aeeb1f9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:46:02.743231 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1b48ab0c-ef2a-43de-b063-aac99aeeb1f9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:46:02.744002 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1b48ab0c-ef2a-43de-b063-aac99aeeb1f9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:46:02.744463 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1b48ab0c-ef2a-43de-b063-aac99aeeb1f9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:46:02.938977 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-1b48ab0c-ef2a-43de-b063-aac99aeeb1f9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:02.950196 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-1b48ab0c-ef2a-43de-b063-aac99aeeb1f9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:02.951725 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-1b48ab0c-ef2a-43de-b063-aac99aeeb1f9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:02.953495 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-1b48ab0c-ef2a-43de-b063-aac99aeeb1f9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1808 microversion: 2.20 time: 0.222448 May 27 03:46:02.954066 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 409/866] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:46:02 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1808 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:46:03.587154 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-c32b47fb-817f-45ad-8044-b5320b29993f tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:46:03.587601 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-c32b47fb-817f-45ad-8044-b5320b29993f tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] [instance: 365c2ebc-713f-475e-a586-fa68bb6b3064] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:46:03.595243 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c32b47fb-817f-45ad-8044-b5320b29993f tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:46:03.595646 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c32b47fb-817f-45ad-8044-b5320b29993f tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:46:03.596463 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c32b47fb-817f-45ad-8044-b5320b29993f tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:46:03.596930 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c32b47fb-817f-45ad-8044-b5320b29993f tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:46:03.804328 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-c32b47fb-817f-45ad-8044-b5320b29993f tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71289d2497de4089bfcdae8474859196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dc5f669f3f483bacc0bf258a11c302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:03.813859 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-c32b47fb-817f-45ad-8044-b5320b29993f tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] 10.222.0.25 "GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064" status: 200 len: 1319 microversion: 2.1 time: 0.229814 May 27 03:46:03.815990 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 458/867] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:46:03 2021] GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064 => generated 1319 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:46:03.971444 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-5647aa4d-a0dd-462d-822c-8786748a648a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:46:03.972105 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-5647aa4d-a0dd-462d-822c-8786748a648a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:46:03.979521 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-5647aa4d-a0dd-462d-822c-8786748a648a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:46:03.979970 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-5647aa4d-a0dd-462d-822c-8786748a648a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:46:03.980764 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-5647aa4d-a0dd-462d-822c-8786748a648a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:46:03.981203 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-5647aa4d-a0dd-462d-822c-8786748a648a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:46:04.190961 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-5647aa4d-a0dd-462d-822c-8786748a648a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:04.200098 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-5647aa4d-a0dd-462d-822c-8786748a648a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:04.201667 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-5647aa4d-a0dd-462d-822c-8786748a648a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:04.202813 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-5647aa4d-a0dd-462d-822c-8786748a648a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1808 microversion: 2.20 time: 0.235573 May 27 03:46:04.203400 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 410/868] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:46:03 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1808 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:46:04.830145 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-6b9686d9-951f-42d8-9c3b-a5000a17d36a tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:46:04.830756 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-6b9686d9-951f-42d8-9c3b-a5000a17d36a tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] [instance: 365c2ebc-713f-475e-a586-fa68bb6b3064] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:46:04.838000 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6b9686d9-951f-42d8-9c3b-a5000a17d36a tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:46:04.838443 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6b9686d9-951f-42d8-9c3b-a5000a17d36a tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:46:04.839205 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6b9686d9-951f-42d8-9c3b-a5000a17d36a tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:46:04.839639 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6b9686d9-951f-42d8-9c3b-a5000a17d36a tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:46:05.032807 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-6b9686d9-951f-42d8-9c3b-a5000a17d36a tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71289d2497de4089bfcdae8474859196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dc5f669f3f483bacc0bf258a11c302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:05.041179 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-6b9686d9-951f-42d8-9c3b-a5000a17d36a tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] 10.222.0.25 "GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064" status: 200 len: 1319 microversion: 2.1 time: 0.215345 May 27 03:46:05.045098 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 459/869] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:46:04 2021] GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064 => generated 1319 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:46:05.220854 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-78d86de6-f8a3-4592-926d-cfcc05c5af2f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:46:05.221458 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-78d86de6-f8a3-4592-926d-cfcc05c5af2f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:46:05.228709 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-78d86de6-f8a3-4592-926d-cfcc05c5af2f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:46:05.233038 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-78d86de6-f8a3-4592-926d-cfcc05c5af2f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:46:05.233038 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-78d86de6-f8a3-4592-926d-cfcc05c5af2f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:46:05.233038 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-78d86de6-f8a3-4592-926d-cfcc05c5af2f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:46:05.429459 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-78d86de6-f8a3-4592-926d-cfcc05c5af2f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:05.439094 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-78d86de6-f8a3-4592-926d-cfcc05c5af2f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:05.440661 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-78d86de6-f8a3-4592-926d-cfcc05c5af2f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:05.441798 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-78d86de6-f8a3-4592-926d-cfcc05c5af2f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1808 microversion: 2.20 time: 0.224779 May 27 03:46:05.442363 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 411/870] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:46:05 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1808 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:46:06.057298 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-067032df-217a-426c-89aa-773e1c7e1bdf tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:46:06.057914 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-067032df-217a-426c-89aa-773e1c7e1bdf tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] [instance: 365c2ebc-713f-475e-a586-fa68bb6b3064] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:46:06.067964 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-067032df-217a-426c-89aa-773e1c7e1bdf tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:46:06.068446 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-067032df-217a-426c-89aa-773e1c7e1bdf tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:46:06.069229 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-067032df-217a-426c-89aa-773e1c7e1bdf tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:46:06.069669 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-067032df-217a-426c-89aa-773e1c7e1bdf tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:46:06.272380 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-067032df-217a-426c-89aa-773e1c7e1bdf tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71289d2497de4089bfcdae8474859196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dc5f669f3f483bacc0bf258a11c302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:06.280552 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-067032df-217a-426c-89aa-773e1c7e1bdf tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] 10.222.0.25 "GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064" status: 200 len: 1319 microversion: 2.1 time: 0.226897 May 27 03:46:06.281062 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 460/871] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:46:06 2021] GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064 => generated 1319 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:46:06.459459 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-651dfafe-48cb-4ae4-9700-130ec89a1987 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:46:06.460076 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-651dfafe-48cb-4ae4-9700-130ec89a1987 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:46:06.467335 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-651dfafe-48cb-4ae4-9700-130ec89a1987 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:46:06.467790 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-651dfafe-48cb-4ae4-9700-130ec89a1987 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:46:06.468606 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-651dfafe-48cb-4ae4-9700-130ec89a1987 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:46:06.469716 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-651dfafe-48cb-4ae4-9700-130ec89a1987 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:46:06.668452 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-651dfafe-48cb-4ae4-9700-130ec89a1987 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:06.677865 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-651dfafe-48cb-4ae4-9700-130ec89a1987 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:06.679402 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-651dfafe-48cb-4ae4-9700-130ec89a1987 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:06.680558 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-651dfafe-48cb-4ae4-9700-130ec89a1987 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1808 microversion: 2.20 time: 0.224909 May 27 03:46:06.681121 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 412/872] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:46:06 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1808 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:46:07.298352 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-1698f94c-b46c-414c-ab18-364ef00815de tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:46:07.298973 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-1698f94c-b46c-414c-ab18-364ef00815de tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] [instance: 365c2ebc-713f-475e-a586-fa68bb6b3064] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:46:07.306404 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1698f94c-b46c-414c-ab18-364ef00815de tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:46:07.306867 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1698f94c-b46c-414c-ab18-364ef00815de tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:46:07.307655 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1698f94c-b46c-414c-ab18-364ef00815de tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:46:07.308100 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1698f94c-b46c-414c-ab18-364ef00815de tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:46:07.502524 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-1698f94c-b46c-414c-ab18-364ef00815de tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71289d2497de4089bfcdae8474859196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dc5f669f3f483bacc0bf258a11c302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:07.512194 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-1698f94c-b46c-414c-ab18-364ef00815de tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] 10.222.0.25 "GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064" status: 200 len: 1319 microversion: 2.1 time: 0.218014 May 27 03:46:07.512872 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 461/873] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:46:07 2021] GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064 => generated 1319 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:46:07.699094 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-001078bf-b495-46e1-9c4d-fcd4204a3e52 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:46:07.699830 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-001078bf-b495-46e1-9c4d-fcd4204a3e52 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:46:07.707146 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-001078bf-b495-46e1-9c4d-fcd4204a3e52 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:46:07.707616 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-001078bf-b495-46e1-9c4d-fcd4204a3e52 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:46:07.708396 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-001078bf-b495-46e1-9c4d-fcd4204a3e52 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:46:07.708892 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-001078bf-b495-46e1-9c4d-fcd4204a3e52 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:46:07.907987 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-001078bf-b495-46e1-9c4d-fcd4204a3e52 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:07.917799 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-001078bf-b495-46e1-9c4d-fcd4204a3e52 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:07.919347 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-001078bf-b495-46e1-9c4d-fcd4204a3e52 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:07.920533 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-001078bf-b495-46e1-9c4d-fcd4204a3e52 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1808 microversion: 2.20 time: 0.225160 May 27 03:46:07.921093 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 413/874] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:46:07 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1808 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:46:08.528858 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-8c45859e-eca7-4e56-930c-1a869b758dbc tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:46:08.529472 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-8c45859e-eca7-4e56-930c-1a869b758dbc tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] [instance: 365c2ebc-713f-475e-a586-fa68bb6b3064] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:46:08.536569 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8c45859e-eca7-4e56-930c-1a869b758dbc tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:46:08.537282 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8c45859e-eca7-4e56-930c-1a869b758dbc tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:46:08.538045 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8c45859e-eca7-4e56-930c-1a869b758dbc tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:46:08.538481 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8c45859e-eca7-4e56-930c-1a869b758dbc tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:46:08.735958 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-8c45859e-eca7-4e56-930c-1a869b758dbc tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71289d2497de4089bfcdae8474859196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dc5f669f3f483bacc0bf258a11c302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:08.744113 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-8c45859e-eca7-4e56-930c-1a869b758dbc tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] 10.222.0.25 "GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064" status: 200 len: 1319 microversion: 2.1 time: 0.218971 May 27 03:46:08.744709 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 462/875] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:46:08 2021] GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064 => generated 1319 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:46:09.043016 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-dd31b42b-8df2-4cda-ab0b-c8eace0d3f6b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:46:09.043575 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-dd31b42b-8df2-4cda-ab0b-c8eace0d3f6b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:46:09.051816 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-dd31b42b-8df2-4cda-ab0b-c8eace0d3f6b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:46:09.052269 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-dd31b42b-8df2-4cda-ab0b-c8eace0d3f6b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:46:09.053075 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-dd31b42b-8df2-4cda-ab0b-c8eace0d3f6b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:46:09.053516 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-dd31b42b-8df2-4cda-ab0b-c8eace0d3f6b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:46:09.245731 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-dd31b42b-8df2-4cda-ab0b-c8eace0d3f6b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:09.254997 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-dd31b42b-8df2-4cda-ab0b-c8eace0d3f6b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:09.259202 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-dd31b42b-8df2-4cda-ab0b-c8eace0d3f6b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:09.259202 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-dd31b42b-8df2-4cda-ab0b-c8eace0d3f6b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1808 microversion: 2.20 time: 0.322836 May 27 03:46:09.259202 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 414/876] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:46:08 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1808 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:46:09.761352 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-eb471c87-3a5a-4723-9b52-eb407bc613f7 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:46:09.761994 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-eb471c87-3a5a-4723-9b52-eb407bc613f7 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] [instance: 365c2ebc-713f-475e-a586-fa68bb6b3064] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:46:09.769922 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-eb471c87-3a5a-4723-9b52-eb407bc613f7 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:46:09.770371 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-eb471c87-3a5a-4723-9b52-eb407bc613f7 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:46:09.771152 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-eb471c87-3a5a-4723-9b52-eb407bc613f7 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:46:09.771589 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-eb471c87-3a5a-4723-9b52-eb407bc613f7 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:46:09.972554 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-eb471c87-3a5a-4723-9b52-eb407bc613f7 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71289d2497de4089bfcdae8474859196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dc5f669f3f483bacc0bf258a11c302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:09.980883 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-eb471c87-3a5a-4723-9b52-eb407bc613f7 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] 10.222.0.25 "GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064" status: 200 len: 1507 microversion: 2.1 time: 0.223318 May 27 03:46:09.981543 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 463/877] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:46:09 2021] GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064 => generated 1507 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:46:10.276132 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-b71f2f75-d55b-4dec-a4a2-205da5ec8a26 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:46:10.276651 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-b71f2f75-d55b-4dec-a4a2-205da5ec8a26 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:46:10.283470 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b71f2f75-d55b-4dec-a4a2-205da5ec8a26 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:46:10.283928 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b71f2f75-d55b-4dec-a4a2-205da5ec8a26 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:46:10.284737 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b71f2f75-d55b-4dec-a4a2-205da5ec8a26 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:46:10.285433 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b71f2f75-d55b-4dec-a4a2-205da5ec8a26 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:46:10.486616 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-b71f2f75-d55b-4dec-a4a2-205da5ec8a26 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:10.507022 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-b71f2f75-d55b-4dec-a4a2-205da5ec8a26 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:10.508572 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-b71f2f75-d55b-4dec-a4a2-205da5ec8a26 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:10.509777 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-b71f2f75-d55b-4dec-a4a2-205da5ec8a26 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1808 microversion: 2.20 time: 0.237924 May 27 03:46:10.510322 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 415/878] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:46:10 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1808 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:46:11.527676 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-d7b5ce4f-1def-4aaa-aa68-7bc9465340da tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:46:11.528573 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-d7b5ce4f-1def-4aaa-aa68-7bc9465340da tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:46:11.537830 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d7b5ce4f-1def-4aaa-aa68-7bc9465340da tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:46:11.539191 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d7b5ce4f-1def-4aaa-aa68-7bc9465340da tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:46:11.539191 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d7b5ce4f-1def-4aaa-aa68-7bc9465340da tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:46:11.539512 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d7b5ce4f-1def-4aaa-aa68-7bc9465340da tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:46:11.762289 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-d7b5ce4f-1def-4aaa-aa68-7bc9465340da tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:11.769247 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-d7b5ce4f-1def-4aaa-aa68-7bc9465340da tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:11.770783 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-d7b5ce4f-1def-4aaa-aa68-7bc9465340da tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:11.771910 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-d7b5ce4f-1def-4aaa-aa68-7bc9465340da tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1808 microversion: 2.20 time: 0.248201 May 27 03:46:11.772483 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 464/879] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:46:11 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1808 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:46:12.790817 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-b766f0cb-73a9-447b-ae13-1665016ff701 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:46:12.791417 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-b766f0cb-73a9-447b-ae13-1665016ff701 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:46:12.799262 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b766f0cb-73a9-447b-ae13-1665016ff701 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:46:12.799715 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b766f0cb-73a9-447b-ae13-1665016ff701 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:46:12.800528 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b766f0cb-73a9-447b-ae13-1665016ff701 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:46:12.800975 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b766f0cb-73a9-447b-ae13-1665016ff701 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:46:13.095486 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-b766f0cb-73a9-447b-ae13-1665016ff701 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:13.105298 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-b766f0cb-73a9-447b-ae13-1665016ff701 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:13.106845 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-b766f0cb-73a9-447b-ae13-1665016ff701 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:13.107998 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-b766f0cb-73a9-447b-ae13-1665016ff701 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1808 microversion: 2.20 time: 0.321290 May 27 03:46:13.108694 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 416/880] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:46:12 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1808 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:46:14.127338 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-dd64e3c2-6fa6-4230-a264-28f63de78fe8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:46:14.127967 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-dd64e3c2-6fa6-4230-a264-28f63de78fe8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:46:14.135158 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-dd64e3c2-6fa6-4230-a264-28f63de78fe8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:46:14.135606 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-dd64e3c2-6fa6-4230-a264-28f63de78fe8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:46:14.136377 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-dd64e3c2-6fa6-4230-a264-28f63de78fe8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:46:14.136878 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-dd64e3c2-6fa6-4230-a264-28f63de78fe8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:46:14.342084 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-dd64e3c2-6fa6-4230-a264-28f63de78fe8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:14.355885 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-dd64e3c2-6fa6-4230-a264-28f63de78fe8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:14.355885 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-dd64e3c2-6fa6-4230-a264-28f63de78fe8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:14.355885 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-dd64e3c2-6fa6-4230-a264-28f63de78fe8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1808 microversion: 2.20 time: 0.232361 May 27 03:46:14.356224 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 465/881] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:46:14 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1808 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:46:15.373677 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-3765c416-7cfa-4504-898d-6a9ebf861180 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:46:15.374359 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-3765c416-7cfa-4504-898d-6a9ebf861180 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:46:15.383052 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-3765c416-7cfa-4504-898d-6a9ebf861180 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:46:15.383563 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-3765c416-7cfa-4504-898d-6a9ebf861180 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:46:15.384346 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-3765c416-7cfa-4504-898d-6a9ebf861180 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:46:15.384813 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-3765c416-7cfa-4504-898d-6a9ebf861180 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:46:15.592568 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-3765c416-7cfa-4504-898d-6a9ebf861180 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:15.601841 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-3765c416-7cfa-4504-898d-6a9ebf861180 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:15.603558 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-3765c416-7cfa-4504-898d-6a9ebf861180 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:15.605174 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-3765c416-7cfa-4504-898d-6a9ebf861180 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1808 microversion: 2.20 time: 0.235306 May 27 03:46:15.606216 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 417/882] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:46:15 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1808 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:46:16.626035 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-4ac142c6-efe6-44af-94ae-1f56b108f428 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:46:16.626583 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-4ac142c6-efe6-44af-94ae-1f56b108f428 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:46:16.634111 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4ac142c6-efe6-44af-94ae-1f56b108f428 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:46:16.634472 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4ac142c6-efe6-44af-94ae-1f56b108f428 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:46:16.635246 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4ac142c6-efe6-44af-94ae-1f56b108f428 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:46:16.635684 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4ac142c6-efe6-44af-94ae-1f56b108f428 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:46:16.838180 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-4ac142c6-efe6-44af-94ae-1f56b108f428 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:16.850643 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-4ac142c6-efe6-44af-94ae-1f56b108f428 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:16.850643 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-4ac142c6-efe6-44af-94ae-1f56b108f428 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:16.850643 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-4ac142c6-efe6-44af-94ae-1f56b108f428 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1808 microversion: 2.20 time: 0.228686 May 27 03:46:16.851314 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 466/883] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:46:16 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1808 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:46:17.869154 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-b38546b3-29bd-4cad-8a06-a21781b66b04 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:46:17.869775 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-b38546b3-29bd-4cad-8a06-a21781b66b04 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:46:17.877402 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b38546b3-29bd-4cad-8a06-a21781b66b04 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:46:17.877852 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b38546b3-29bd-4cad-8a06-a21781b66b04 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:46:17.878623 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b38546b3-29bd-4cad-8a06-a21781b66b04 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:46:17.879055 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b38546b3-29bd-4cad-8a06-a21781b66b04 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:46:18.073913 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-b38546b3-29bd-4cad-8a06-a21781b66b04 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:18.083693 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-b38546b3-29bd-4cad-8a06-a21781b66b04 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:18.085200 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-b38546b3-29bd-4cad-8a06-a21781b66b04 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:18.086349 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-b38546b3-29bd-4cad-8a06-a21781b66b04 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1808 microversion: 2.20 time: 0.220991 May 27 03:46:18.086914 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 418/884] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:46:17 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1808 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:46:19.104374 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-1d3ff347-b205-461a-b1f2-4a061730d029 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:46:19.105086 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-1d3ff347-b205-461a-b1f2-4a061730d029 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:46:19.112680 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1d3ff347-b205-461a-b1f2-4a061730d029 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:46:19.113139 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1d3ff347-b205-461a-b1f2-4a061730d029 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:46:19.114077 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1d3ff347-b205-461a-b1f2-4a061730d029 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:46:19.114369 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1d3ff347-b205-461a-b1f2-4a061730d029 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:46:19.168711 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [req-204b7a05-6ca4-4b77-a05e-d9a2d45eecea req-6e239724-5ca0-4d61-b609-8fbf6b3fcbd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e367eb4b-29c5-4f41-b41d-0da84d751fe2", "name": "network-vif-plugged", "status": "completed", "tag": "396ee32c-72a8-43ea-b35c-f0de6de19d7a"}]} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:46:19.173293 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:46:19.173293 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: warnings.warn(msg) May 27 03:46:19.183452 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-204b7a05-6ca4-4b77-a05e-d9a2d45eecea req-6e239724-5ca0-4d61-b609-8fbf6b3fcbd6 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:46:19.183936 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-204b7a05-6ca4-4b77-a05e-d9a2d45eecea req-6e239724-5ca0-4d61-b609-8fbf6b3fcbd6 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:46:19.200812 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.compute.server_external_events [req-204b7a05-6ca4-4b77-a05e-d9a2d45eecea req-6e239724-5ca0-4d61-b609-8fbf6b3fcbd6 service nova] Creating event network-vif-plugged:396ee32c-72a8-43ea-b35c-f0de6de19d7a for instance e367eb4b-29c5-4f41-b41d-0da84d751fe2 on hv-cinder-79326 May 27 03:46:19.206280 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [req-204b7a05-6ca4-4b77-a05e-d9a2d45eecea req-6e239724-5ca0-4d61-b609-8fbf6b3fcbd6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042388 May 27 03:46:19.206881 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 419/885] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:46:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:46:19.325014 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-1d3ff347-b205-461a-b1f2-4a061730d029 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:19.334921 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-1d3ff347-b205-461a-b1f2-4a061730d029 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:19.336539 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-1d3ff347-b205-461a-b1f2-4a061730d029 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:19.337712 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-1d3ff347-b205-461a-b1f2-4a061730d029 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1808 microversion: 2.20 time: 0.237074 May 27 03:46:19.338313 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 467/886] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:46:19 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1808 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:46:20.357201 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-76896069-b617-4d06-964d-debbb824884a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:46:20.358010 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-76896069-b617-4d06-964d-debbb824884a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:46:20.366351 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-76896069-b617-4d06-964d-debbb824884a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:46:20.366807 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-76896069-b617-4d06-964d-debbb824884a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:46:20.367580 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-76896069-b617-4d06-964d-debbb824884a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:46:20.368019 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-76896069-b617-4d06-964d-debbb824884a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:46:20.718998 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-76896069-b617-4d06-964d-debbb824884a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:20.729105 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-76896069-b617-4d06-964d-debbb824884a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:20.730757 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-76896069-b617-4d06-964d-debbb824884a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:20.731903 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-76896069-b617-4d06-964d-debbb824884a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1808 microversion: 2.20 time: 0.379014 May 27 03:46:20.740286 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 420/887] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:46:20 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1808 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:46:21.751306 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-eee97b46-6a5e-496d-ab05-a8ddc65654cf tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:46:21.752023 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-eee97b46-6a5e-496d-ab05-a8ddc65654cf tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:46:21.760387 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-eee97b46-6a5e-496d-ab05-a8ddc65654cf tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:46:21.760969 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-eee97b46-6a5e-496d-ab05-a8ddc65654cf tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:46:21.762094 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-eee97b46-6a5e-496d-ab05-a8ddc65654cf tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:46:21.762822 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-eee97b46-6a5e-496d-ab05-a8ddc65654cf tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:46:21.979375 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-eee97b46-6a5e-496d-ab05-a8ddc65654cf tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:21.988503 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-eee97b46-6a5e-496d-ab05-a8ddc65654cf tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:21.990082 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-eee97b46-6a5e-496d-ab05-a8ddc65654cf tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:21.991208 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-eee97b46-6a5e-496d-ab05-a8ddc65654cf tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1808 microversion: 2.20 time: 0.244516 May 27 03:46:21.991769 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 468/888] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:46:21 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1808 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:46:23.008995 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-624aa46e-12c7-4acb-971e-4bcbea5e9563 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:46:23.009601 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-624aa46e-12c7-4acb-971e-4bcbea5e9563 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:46:23.020477 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-624aa46e-12c7-4acb-971e-4bcbea5e9563 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:46:23.021492 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-624aa46e-12c7-4acb-971e-4bcbea5e9563 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:46:23.022475 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-624aa46e-12c7-4acb-971e-4bcbea5e9563 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:46:23.022770 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-624aa46e-12c7-4acb-971e-4bcbea5e9563 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:46:23.223510 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-624aa46e-12c7-4acb-971e-4bcbea5e9563 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:23.231260 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-624aa46e-12c7-4acb-971e-4bcbea5e9563 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:23.232810 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-624aa46e-12c7-4acb-971e-4bcbea5e9563 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:23.234480 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-624aa46e-12c7-4acb-971e-4bcbea5e9563 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1808 microversion: 2.20 time: 0.228995 May 27 03:46:23.235136 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 421/889] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:46:23 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1808 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:46:24.254127 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-64412400-8dd0-47c8-b307-c5605c5b0357 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:46:24.254857 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-64412400-8dd0-47c8-b307-c5605c5b0357 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:46:24.262235 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-64412400-8dd0-47c8-b307-c5605c5b0357 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:46:24.262690 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-64412400-8dd0-47c8-b307-c5605c5b0357 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:46:24.263461 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-64412400-8dd0-47c8-b307-c5605c5b0357 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:46:24.263907 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-64412400-8dd0-47c8-b307-c5605c5b0357 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:46:24.468082 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-64412400-8dd0-47c8-b307-c5605c5b0357 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:24.477611 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-64412400-8dd0-47c8-b307-c5605c5b0357 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:24.479181 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-64412400-8dd0-47c8-b307-c5605c5b0357 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:24.480320 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-64412400-8dd0-47c8-b307-c5605c5b0357 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1795 microversion: 2.20 time: 0.230782 May 27 03:46:24.480907 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 469/890] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:46:24 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1795 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:46:38.197304 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-29b8119b-6710-439e-9f02-6732353cdbc9 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "62624067-89cf-47e9-8fdf-8e48377c2e25", "device": "/dev/sdb"}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:46:38.198875 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-29b8119b-6710-439e-9f02-6732353cdbc9 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] [instance: 365c2ebc-713f-475e-a586-fa68bb6b3064] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:46:38.206012 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-29b8119b-6710-439e-9f02-6732353cdbc9 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:46:38.206467 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-29b8119b-6710-439e-9f02-6732353cdbc9 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:46:38.207230 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-29b8119b-6710-439e-9f02-6732353cdbc9 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:46:38.207663 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-29b8119b-6710-439e-9f02-6732353cdbc9 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:46:40.904227 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-29b8119b-6710-439e-9f02-6732353cdbc9 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] 10.222.0.25 "POST /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.710555 May 27 03:46:40.904930 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 422/891] 10.222.0.25 () {60 vars in 1323 bytes} [Thu May 27 03:46:38 2021] POST /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064/os-volume_attachments => generated 194 bytes in 2712 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:46:50.917742 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: ERROR oslo.messaging._drivers.impl_rabbit [-] [76781c65-3633-4e79-8ccf-55fa2808f360] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 27 03:46:50.921121 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-af990212-ea9f-46d2-9e54-0511c84a3bc6 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:46:50.921633 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-af990212-ea9f-46d2-9e54-0511c84a3bc6 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] [instance: 02984890-fe33-4d25-bf6d-a3c3163a965f] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:46:50.929444 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-af990212-ea9f-46d2-9e54-0511c84a3bc6 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:46:50.932691 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-af990212-ea9f-46d2-9e54-0511c84a3bc6 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:46:50.932691 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-af990212-ea9f-46d2-9e54-0511c84a3bc6 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:46:50.932691 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-af990212-ea9f-46d2-9e54-0511c84a3bc6 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:46:50.986677 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.objects.instance [None req-af990212-ea9f-46d2-9e54-0511c84a3bc6 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lazy-loading 'flavor' on Instance uuid 02984890-fe33-4d25-bf6d-a3c3163a965f {{(pid=113020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 27 03:46:51.300706 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-af990212-ea9f-46d2-9e54-0511c84a3bc6 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] 10.222.0.25 "POST /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f/action" status: 202 len: 0 microversion: 2.1 time: 0.384118 May 27 03:46:51.301363 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 470/892] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:46:50 2021] POST /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f/action => generated 0 bytes in 386 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:46:51.310960 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-29261c6d-1488-4acc-b26c-c9c0bc42a642 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:46:51.312363 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-29261c6d-1488-4acc-b26c-c9c0bc42a642 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] [instance: 02984890-fe33-4d25-bf6d-a3c3163a965f] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:46:51.321355 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-29261c6d-1488-4acc-b26c-c9c0bc42a642 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:46:51.324419 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-29261c6d-1488-4acc-b26c-c9c0bc42a642 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:46:51.324419 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-29261c6d-1488-4acc-b26c-c9c0bc42a642 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:46:51.324419 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-29261c6d-1488-4acc-b26c-c9c0bc42a642 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:46:51.525531 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-29261c6d-1488-4acc-b26c-c9c0bc42a642 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023704e9bd7e4bfcace7a3fa2ec9d919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450ff0f7a98a4ae385a74e4ddaf301ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:51.533867 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-29261c6d-1488-4acc-b26c-c9c0bc42a642 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] 10.222.0.25 "GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f" status: 200 len: 1568 microversion: 2.1 time: 0.227771 May 27 03:46:51.534425 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 423/893] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:46:51 2021] GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f => generated 1568 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:46:52.551779 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-7c15d6d8-72fa-4cf3-b516-151eb0cd2ab8 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:46:52.552519 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-7c15d6d8-72fa-4cf3-b516-151eb0cd2ab8 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] [instance: 02984890-fe33-4d25-bf6d-a3c3163a965f] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:46:52.572264 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7c15d6d8-72fa-4cf3-b516-151eb0cd2ab8 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:46:52.572737 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7c15d6d8-72fa-4cf3-b516-151eb0cd2ab8 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:46:52.573537 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7c15d6d8-72fa-4cf3-b516-151eb0cd2ab8 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:46:52.573968 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7c15d6d8-72fa-4cf3-b516-151eb0cd2ab8 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:46:52.609648 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO oslo.messaging._drivers.impl_rabbit [-] [76781c65-3633-4e79-8ccf-55fa2808f360] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 39298. May 27 03:46:52.774020 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-7c15d6d8-72fa-4cf3-b516-151eb0cd2ab8 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023704e9bd7e4bfcace7a3fa2ec9d919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450ff0f7a98a4ae385a74e4ddaf301ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:52.782250 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-7c15d6d8-72fa-4cf3-b516-151eb0cd2ab8 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] 10.222.0.25 "GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f" status: 200 len: 1568 microversion: 2.1 time: 0.234616 May 27 03:46:52.782813 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 471/894] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:46:52 2021] GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f => generated 1568 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:46:53.799323 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-25c29d9d-a152-4797-8d29-8aef68ced829 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:46:53.799950 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-25c29d9d-a152-4797-8d29-8aef68ced829 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] [instance: 02984890-fe33-4d25-bf6d-a3c3163a965f] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:46:53.807638 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-25c29d9d-a152-4797-8d29-8aef68ced829 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:46:53.808097 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-25c29d9d-a152-4797-8d29-8aef68ced829 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:46:53.808920 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-25c29d9d-a152-4797-8d29-8aef68ced829 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:46:53.809367 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-25c29d9d-a152-4797-8d29-8aef68ced829 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:46:53.998227 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-25c29d9d-a152-4797-8d29-8aef68ced829 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023704e9bd7e4bfcace7a3fa2ec9d919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450ff0f7a98a4ae385a74e4ddaf301ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:54.006956 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-25c29d9d-a152-4797-8d29-8aef68ced829 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] 10.222.0.25 "GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f" status: 200 len: 1568 microversion: 2.1 time: 0.211352 May 27 03:46:54.007514 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 424/895] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:46:53 2021] GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f => generated 1568 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:46:55.023514 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-60bf3720-7dc8-4e5c-a261-4fe5abf6d103 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:46:55.024124 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-60bf3720-7dc8-4e5c-a261-4fe5abf6d103 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] [instance: 02984890-fe33-4d25-bf6d-a3c3163a965f] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:46:55.031679 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-60bf3720-7dc8-4e5c-a261-4fe5abf6d103 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:46:55.032134 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-60bf3720-7dc8-4e5c-a261-4fe5abf6d103 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:46:55.033543 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-60bf3720-7dc8-4e5c-a261-4fe5abf6d103 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:46:55.034002 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-60bf3720-7dc8-4e5c-a261-4fe5abf6d103 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:46:55.224329 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-60bf3720-7dc8-4e5c-a261-4fe5abf6d103 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023704e9bd7e4bfcace7a3fa2ec9d919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450ff0f7a98a4ae385a74e4ddaf301ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:55.232428 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-60bf3720-7dc8-4e5c-a261-4fe5abf6d103 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] 10.222.0.25 "GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f" status: 200 len: 1568 microversion: 2.1 time: 0.212611 May 27 03:46:55.233003 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 472/896] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:46:55 2021] GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f => generated 1568 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:46:56.248965 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-5f2fa433-fb85-41e5-b594-ff46615808a8 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:46:56.249585 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-5f2fa433-fb85-41e5-b594-ff46615808a8 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] [instance: 02984890-fe33-4d25-bf6d-a3c3163a965f] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:46:56.256913 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-5f2fa433-fb85-41e5-b594-ff46615808a8 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:46:56.257370 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-5f2fa433-fb85-41e5-b594-ff46615808a8 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:46:56.258140 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-5f2fa433-fb85-41e5-b594-ff46615808a8 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:46:56.258582 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-5f2fa433-fb85-41e5-b594-ff46615808a8 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:46:56.450221 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-5f2fa433-fb85-41e5-b594-ff46615808a8 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023704e9bd7e4bfcace7a3fa2ec9d919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450ff0f7a98a4ae385a74e4ddaf301ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:56.459053 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-5f2fa433-fb85-41e5-b594-ff46615808a8 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] 10.222.0.25 "GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f" status: 200 len: 1568 microversion: 2.1 time: 0.213718 May 27 03:46:56.459748 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 425/897] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:46:56 2021] GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f => generated 1568 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:46:57.476039 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-7c9622cc-ec4b-41a5-b5f0-745000f73ef8 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:46:57.476738 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-7c9622cc-ec4b-41a5-b5f0-745000f73ef8 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] [instance: 02984890-fe33-4d25-bf6d-a3c3163a965f] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:46:57.483961 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7c9622cc-ec4b-41a5-b5f0-745000f73ef8 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:46:57.484484 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7c9622cc-ec4b-41a5-b5f0-745000f73ef8 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:46:57.485685 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7c9622cc-ec4b-41a5-b5f0-745000f73ef8 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:46:57.486130 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7c9622cc-ec4b-41a5-b5f0-745000f73ef8 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:46:57.681972 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-7c9622cc-ec4b-41a5-b5f0-745000f73ef8 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023704e9bd7e4bfcace7a3fa2ec9d919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450ff0f7a98a4ae385a74e4ddaf301ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:57.690558 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-7c9622cc-ec4b-41a5-b5f0-745000f73ef8 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] 10.222.0.25 "GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f" status: 200 len: 1568 microversion: 2.1 time: 0.218245 May 27 03:46:57.691123 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 473/898] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:46:57 2021] GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f => generated 1568 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:46:58.706885 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-a395ef07-ac48-4abf-a17f-2ffd4afff355 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:46:58.707506 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-a395ef07-ac48-4abf-a17f-2ffd4afff355 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] [instance: 02984890-fe33-4d25-bf6d-a3c3163a965f] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:46:58.715139 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a395ef07-ac48-4abf-a17f-2ffd4afff355 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:46:58.715589 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a395ef07-ac48-4abf-a17f-2ffd4afff355 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:46:58.716358 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a395ef07-ac48-4abf-a17f-2ffd4afff355 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:46:58.716823 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a395ef07-ac48-4abf-a17f-2ffd4afff355 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:46:58.913071 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-a395ef07-ac48-4abf-a17f-2ffd4afff355 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023704e9bd7e4bfcace7a3fa2ec9d919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450ff0f7a98a4ae385a74e4ddaf301ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:46:58.921442 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-a395ef07-ac48-4abf-a17f-2ffd4afff355 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] 10.222.0.25 "GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f" status: 200 len: 1568 microversion: 2.1 time: 0.218288 May 27 03:46:58.922007 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 426/899] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:46:58 2021] GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f => generated 1568 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:46:59.939172 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-842886e7-0d73-442c-b5f2-7aca0b11bbfc tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:46:59.939803 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-842886e7-0d73-442c-b5f2-7aca0b11bbfc tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] [instance: 02984890-fe33-4d25-bf6d-a3c3163a965f] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:46:59.946972 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-842886e7-0d73-442c-b5f2-7aca0b11bbfc tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:46:59.953378 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-842886e7-0d73-442c-b5f2-7aca0b11bbfc tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:46:59.953378 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-842886e7-0d73-442c-b5f2-7aca0b11bbfc tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:46:59.953378 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-842886e7-0d73-442c-b5f2-7aca0b11bbfc tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:00.146664 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-842886e7-0d73-442c-b5f2-7aca0b11bbfc tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023704e9bd7e4bfcace7a3fa2ec9d919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450ff0f7a98a4ae385a74e4ddaf301ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:47:00.154953 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-842886e7-0d73-442c-b5f2-7aca0b11bbfc tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] 10.222.0.25 "GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f" status: 200 len: 1568 microversion: 2.1 time: 0.219987 May 27 03:47:00.155515 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 474/900] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:46:59 2021] GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f => generated 1568 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:47:01.172023 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-c1e543eb-3a66-419f-a962-cd6d3d264b52 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:47:01.172583 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-c1e543eb-3a66-419f-a962-cd6d3d264b52 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] [instance: 02984890-fe33-4d25-bf6d-a3c3163a965f] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:47:01.179772 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c1e543eb-3a66-419f-a962-cd6d3d264b52 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:01.180227 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c1e543eb-3a66-419f-a962-cd6d3d264b52 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:01.181045 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c1e543eb-3a66-419f-a962-cd6d3d264b52 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:01.181479 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c1e543eb-3a66-419f-a962-cd6d3d264b52 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:01.374160 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-c1e543eb-3a66-419f-a962-cd6d3d264b52 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023704e9bd7e4bfcace7a3fa2ec9d919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450ff0f7a98a4ae385a74e4ddaf301ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:47:01.382797 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-c1e543eb-3a66-419f-a962-cd6d3d264b52 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] 10.222.0.25 "GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f" status: 200 len: 1568 microversion: 2.1 time: 0.214517 May 27 03:47:01.383349 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 427/901] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:47:01 2021] GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f => generated 1568 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:47:02.400063 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-5fadf101-8418-421f-ab8b-e1c55fcbe25a tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:47:02.400706 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-5fadf101-8418-421f-ab8b-e1c55fcbe25a tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] [instance: 02984890-fe33-4d25-bf6d-a3c3163a965f] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:47:02.408412 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-5fadf101-8418-421f-ab8b-e1c55fcbe25a tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:02.408873 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-5fadf101-8418-421f-ab8b-e1c55fcbe25a tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:02.409644 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-5fadf101-8418-421f-ab8b-e1c55fcbe25a tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:02.410081 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-5fadf101-8418-421f-ab8b-e1c55fcbe25a tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:02.602160 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-5fadf101-8418-421f-ab8b-e1c55fcbe25a tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023704e9bd7e4bfcace7a3fa2ec9d919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450ff0f7a98a4ae385a74e4ddaf301ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:47:02.611384 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-5fadf101-8418-421f-ab8b-e1c55fcbe25a tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] 10.222.0.25 "GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f" status: 200 len: 1568 microversion: 2.1 time: 0.215004 May 27 03:47:02.611955 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 475/902] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:47:02 2021] GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f => generated 1568 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:47:03.628053 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-7b6943c6-b338-4053-bbc9-ee0a4dc86103 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:47:03.628618 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-7b6943c6-b338-4053-bbc9-ee0a4dc86103 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] [instance: 02984890-fe33-4d25-bf6d-a3c3163a965f] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:47:03.637058 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-7b6943c6-b338-4053-bbc9-ee0a4dc86103 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:03.637512 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-7b6943c6-b338-4053-bbc9-ee0a4dc86103 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:03.638299 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-7b6943c6-b338-4053-bbc9-ee0a4dc86103 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:03.638735 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-7b6943c6-b338-4053-bbc9-ee0a4dc86103 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:03.908743 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-7b6943c6-b338-4053-bbc9-ee0a4dc86103 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023704e9bd7e4bfcace7a3fa2ec9d919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450ff0f7a98a4ae385a74e4ddaf301ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:47:03.917128 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-7b6943c6-b338-4053-bbc9-ee0a4dc86103 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] 10.222.0.25 "GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f" status: 200 len: 1568 microversion: 2.1 time: 0.292887 May 27 03:47:03.917680 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 428/903] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:47:03 2021] GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f => generated 1568 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:47:04.935008 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-fee60006-c890-4dd2-a58a-8d85dbfb22f6 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:47:04.935662 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-fee60006-c890-4dd2-a58a-8d85dbfb22f6 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] [instance: 02984890-fe33-4d25-bf6d-a3c3163a965f] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:47:04.943534 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-fee60006-c890-4dd2-a58a-8d85dbfb22f6 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:04.946528 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-fee60006-c890-4dd2-a58a-8d85dbfb22f6 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:04.946528 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-fee60006-c890-4dd2-a58a-8d85dbfb22f6 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:04.946528 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-fee60006-c890-4dd2-a58a-8d85dbfb22f6 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:05.137915 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-fee60006-c890-4dd2-a58a-8d85dbfb22f6 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023704e9bd7e4bfcace7a3fa2ec9d919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450ff0f7a98a4ae385a74e4ddaf301ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:47:05.146049 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-fee60006-c890-4dd2-a58a-8d85dbfb22f6 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] 10.222.0.25 "GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f" status: 200 len: 1568 microversion: 2.1 time: 0.214751 May 27 03:47:05.146610 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 476/904] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:47:04 2021] GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f => generated 1568 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:47:06.163123 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-f8b871a0-536a-497e-9a42-08332dae688d tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:47:06.163737 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-f8b871a0-536a-497e-9a42-08332dae688d tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] [instance: 02984890-fe33-4d25-bf6d-a3c3163a965f] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:47:06.171045 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f8b871a0-536a-497e-9a42-08332dae688d tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:06.171501 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f8b871a0-536a-497e-9a42-08332dae688d tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:06.172268 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f8b871a0-536a-497e-9a42-08332dae688d tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:06.173238 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f8b871a0-536a-497e-9a42-08332dae688d tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:06.367665 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-f8b871a0-536a-497e-9a42-08332dae688d tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023704e9bd7e4bfcace7a3fa2ec9d919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450ff0f7a98a4ae385a74e4ddaf301ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:47:06.376502 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-f8b871a0-536a-497e-9a42-08332dae688d tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] 10.222.0.25 "GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f" status: 200 len: 1568 microversion: 2.1 time: 0.216655 May 27 03:47:06.377062 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 429/905] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:47:06 2021] GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f => generated 1568 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:47:07.393325 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-85c73c1c-acc2-461e-80f3-bd0a7026870f tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:47:07.393942 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-85c73c1c-acc2-461e-80f3-bd0a7026870f tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] [instance: 02984890-fe33-4d25-bf6d-a3c3163a965f] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:47:07.401465 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-85c73c1c-acc2-461e-80f3-bd0a7026870f tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:07.406641 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-85c73c1c-acc2-461e-80f3-bd0a7026870f tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:07.406641 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-85c73c1c-acc2-461e-80f3-bd0a7026870f tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:07.406641 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-85c73c1c-acc2-461e-80f3-bd0a7026870f tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:07.603456 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-85c73c1c-acc2-461e-80f3-bd0a7026870f tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023704e9bd7e4bfcace7a3fa2ec9d919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450ff0f7a98a4ae385a74e4ddaf301ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:47:07.611529 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-85c73c1c-acc2-461e-80f3-bd0a7026870f tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] 10.222.0.25 "GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f" status: 200 len: 1568 microversion: 2.1 time: 0.222508 May 27 03:47:07.612089 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 477/906] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:47:07 2021] GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f => generated 1568 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:47:08.628126 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-7ed3b43d-69f2-4c62-b1cc-5b348eed35d6 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:47:08.628777 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-7ed3b43d-69f2-4c62-b1cc-5b348eed35d6 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] [instance: 02984890-fe33-4d25-bf6d-a3c3163a965f] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:47:08.636510 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-7ed3b43d-69f2-4c62-b1cc-5b348eed35d6 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:08.636973 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-7ed3b43d-69f2-4c62-b1cc-5b348eed35d6 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:08.637754 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-7ed3b43d-69f2-4c62-b1cc-5b348eed35d6 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:08.638198 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-7ed3b43d-69f2-4c62-b1cc-5b348eed35d6 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:08.827413 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-7ed3b43d-69f2-4c62-b1cc-5b348eed35d6 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023704e9bd7e4bfcace7a3fa2ec9d919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450ff0f7a98a4ae385a74e4ddaf301ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:47:08.836452 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-7ed3b43d-69f2-4c62-b1cc-5b348eed35d6 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] 10.222.0.25 "GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f" status: 200 len: 1568 microversion: 2.1 time: 0.211985 May 27 03:47:08.837011 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 430/907] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:47:08 2021] GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f => generated 1568 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:47:09.853379 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-a305f5c0-15e7-4ecf-be95-d216e0bf092a tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:47:09.854034 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-a305f5c0-15e7-4ecf-be95-d216e0bf092a tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] [instance: 02984890-fe33-4d25-bf6d-a3c3163a965f] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:47:09.861801 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a305f5c0-15e7-4ecf-be95-d216e0bf092a tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:09.862251 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a305f5c0-15e7-4ecf-be95-d216e0bf092a tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:09.863021 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a305f5c0-15e7-4ecf-be95-d216e0bf092a tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:09.863459 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a305f5c0-15e7-4ecf-be95-d216e0bf092a tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:10.060529 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-a305f5c0-15e7-4ecf-be95-d216e0bf092a tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023704e9bd7e4bfcace7a3fa2ec9d919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450ff0f7a98a4ae385a74e4ddaf301ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:47:10.068601 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-a305f5c0-15e7-4ecf-be95-d216e0bf092a tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] 10.222.0.25 "GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f" status: 200 len: 1568 microversion: 2.1 time: 0.218801 May 27 03:47:10.069227 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 478/908] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:47:09 2021] GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f => generated 1568 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:47:11.085490 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-482a67ea-140d-4915-848c-5403f9505f23 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:47:11.086209 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-482a67ea-140d-4915-848c-5403f9505f23 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] [instance: 02984890-fe33-4d25-bf6d-a3c3163a965f] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:47:11.093509 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-482a67ea-140d-4915-848c-5403f9505f23 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:11.093960 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-482a67ea-140d-4915-848c-5403f9505f23 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:11.095225 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-482a67ea-140d-4915-848c-5403f9505f23 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:11.095660 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-482a67ea-140d-4915-848c-5403f9505f23 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:11.291501 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-482a67ea-140d-4915-848c-5403f9505f23 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023704e9bd7e4bfcace7a3fa2ec9d919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450ff0f7a98a4ae385a74e4ddaf301ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:47:11.300535 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-482a67ea-140d-4915-848c-5403f9505f23 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] 10.222.0.25 "GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f" status: 200 len: 1568 microversion: 2.1 time: 0.218630 May 27 03:47:11.301100 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 431/909] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:47:11 2021] GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f => generated 1568 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:47:12.317600 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-49483f10-03e0-4495-be47-b8e8db516f34 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:47:12.318220 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-49483f10-03e0-4495-be47-b8e8db516f34 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] [instance: 02984890-fe33-4d25-bf6d-a3c3163a965f] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:47:12.326489 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-49483f10-03e0-4495-be47-b8e8db516f34 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:12.326489 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-49483f10-03e0-4495-be47-b8e8db516f34 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:12.326703 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-49483f10-03e0-4495-be47-b8e8db516f34 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:12.327123 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-49483f10-03e0-4495-be47-b8e8db516f34 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:12.531188 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-49483f10-03e0-4495-be47-b8e8db516f34 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023704e9bd7e4bfcace7a3fa2ec9d919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450ff0f7a98a4ae385a74e4ddaf301ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:47:12.538648 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-49483f10-03e0-4495-be47-b8e8db516f34 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] 10.222.0.25 "GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f" status: 200 len: 1568 microversion: 2.1 time: 0.225242 May 27 03:47:12.539219 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 479/910] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:47:12 2021] GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f => generated 1568 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:47:13.556823 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-0c72a788-7fee-4eea-97d8-e1839ea87bb0 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:47:13.557383 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-0c72a788-7fee-4eea-97d8-e1839ea87bb0 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] [instance: 02984890-fe33-4d25-bf6d-a3c3163a965f] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:47:13.564578 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-0c72a788-7fee-4eea-97d8-e1839ea87bb0 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:13.565038 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-0c72a788-7fee-4eea-97d8-e1839ea87bb0 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:13.565824 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-0c72a788-7fee-4eea-97d8-e1839ea87bb0 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:13.566249 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-0c72a788-7fee-4eea-97d8-e1839ea87bb0 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:13.763776 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-0c72a788-7fee-4eea-97d8-e1839ea87bb0 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023704e9bd7e4bfcace7a3fa2ec9d919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450ff0f7a98a4ae385a74e4ddaf301ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:47:13.772460 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-0c72a788-7fee-4eea-97d8-e1839ea87bb0 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] 10.222.0.25 "GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f" status: 200 len: 1509 microversion: 2.1 time: 0.219343 May 27 03:47:13.773029 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 432/911] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:47:13 2021] GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f => generated 1509 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:47:13.789205 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-ac166c74-62c8-4255-9586-ac4937765fbd tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:47:13.789779 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-ac166c74-62c8-4255-9586-ac4937765fbd tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] [instance: 02984890-fe33-4d25-bf6d-a3c3163a965f] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:47:13.796951 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ac166c74-62c8-4255-9586-ac4937765fbd tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:13.797402 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ac166c74-62c8-4255-9586-ac4937765fbd tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:13.798202 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ac166c74-62c8-4255-9586-ac4937765fbd tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:13.798642 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ac166c74-62c8-4255-9586-ac4937765fbd tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:14.180911 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-ac166c74-62c8-4255-9586-ac4937765fbd tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] 10.222.0.25 "POST /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f/action" status: 202 len: 0 microversion: 2.1 time: 0.395549 May 27 03:47:14.181568 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 480/912] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:47:13 2021] POST /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f/action => generated 0 bytes in 397 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:47:14.190081 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-e868959d-87dc-44ce-bc32-8428268fa9f2 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:47:14.191378 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-e868959d-87dc-44ce-bc32-8428268fa9f2 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] [instance: 02984890-fe33-4d25-bf6d-a3c3163a965f] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:47:14.198265 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e868959d-87dc-44ce-bc32-8428268fa9f2 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:14.199019 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e868959d-87dc-44ce-bc32-8428268fa9f2 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:14.199836 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e868959d-87dc-44ce-bc32-8428268fa9f2 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:14.200276 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e868959d-87dc-44ce-bc32-8428268fa9f2 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:14.403395 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-e868959d-87dc-44ce-bc32-8428268fa9f2 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023704e9bd7e4bfcace7a3fa2ec9d919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450ff0f7a98a4ae385a74e4ddaf301ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:47:14.412361 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-e868959d-87dc-44ce-bc32-8428268fa9f2 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] 10.222.0.25 "GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f" status: 200 len: 1517 microversion: 2.1 time: 0.226519 May 27 03:47:14.412949 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 433/913] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:47:14 2021] GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f => generated 1517 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:47:14.740813 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-c758c03b-be4a-4d53-a10c-e2512428d803 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:47:14.741310 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-c758c03b-be4a-4d53-a10c-e2512428d803 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] [instance: 365c2ebc-713f-475e-a586-fa68bb6b3064] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:47:14.748514 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c758c03b-be4a-4d53-a10c-e2512428d803 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:14.748966 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c758c03b-be4a-4d53-a10c-e2512428d803 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:14.749736 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c758c03b-be4a-4d53-a10c-e2512428d803 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:14.750175 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c758c03b-be4a-4d53-a10c-e2512428d803 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:14.910059 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.objects.instance [None req-c758c03b-be4a-4d53-a10c-e2512428d803 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lazy-loading 'services' on Instance uuid 365c2ebc-713f-475e-a586-fa68bb6b3064 {{(pid=113020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 27 03:47:15.150188 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-c758c03b-be4a-4d53-a10c-e2512428d803 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] 10.222.0.25 "DELETE /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064/os-volume_attachments/62624067-89cf-47e9-8fdf-8e48377c2e25" status: 202 len: 0 microversion: 2.1 time: 0.412700 May 27 03:47:15.150778 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 481/914] 10.222.0.25 () {58 vars in 1416 bytes} [Thu May 27 03:47:14 2021] DELETE /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064/os-volume_attachments/62624067-89cf-47e9-8fdf-8e48377c2e25 => generated 0 bytes in 414 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:47:15.430090 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-c3368d3d-94bd-4c12-90a6-a43f21c3e92f tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:47:15.430974 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-c3368d3d-94bd-4c12-90a6-a43f21c3e92f tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] [instance: 02984890-fe33-4d25-bf6d-a3c3163a965f] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:47:15.442443 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c3368d3d-94bd-4c12-90a6-a43f21c3e92f tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:15.442443 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c3368d3d-94bd-4c12-90a6-a43f21c3e92f tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:15.442443 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c3368d3d-94bd-4c12-90a6-a43f21c3e92f tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:15.442443 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c3368d3d-94bd-4c12-90a6-a43f21c3e92f tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:15.582585 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [req-d30c0f0c-8b35-418a-83a2-132c7c4f84c3 req-8f6d69e5-69c2-4bbb-b0ee-1582c97788ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02984890-fe33-4d25-bf6d-a3c3163a965f", "name": "network-vif-unplugged", "status": "completed", "tag": "2554297d-a794-4bc9-9cb3-56dce4e9fb2f"}]} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:47:15.585095 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:47:15.585095 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: warnings.warn(msg) May 27 03:47:15.595345 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-d30c0f0c-8b35-418a-83a2-132c7c4f84c3 req-8f6d69e5-69c2-4bbb-b0ee-1582c97788ba service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:15.596029 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-d30c0f0c-8b35-418a-83a2-132c7c4f84c3 req-8f6d69e5-69c2-4bbb-b0ee-1582c97788ba service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:15.614516 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.compute.server_external_events [req-d30c0f0c-8b35-418a-83a2-132c7c4f84c3 req-8f6d69e5-69c2-4bbb-b0ee-1582c97788ba service nova] Unable to find a host for instance 02984890-fe33-4d25-bf6d-a3c3163a965f. Dropping event network-vif-unplugged {{(pid=113021) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} May 27 03:47:15.615586 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [req-d30c0f0c-8b35-418a-83a2-132c7c4f84c3 req-8f6d69e5-69c2-4bbb-b0ee-1582c97788ba service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.184226 May 27 03:47:15.616728 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 434/915] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:47:15 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 193 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) May 27 03:47:15.677850 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-c3368d3d-94bd-4c12-90a6-a43f21c3e92f tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023704e9bd7e4bfcace7a3fa2ec9d919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450ff0f7a98a4ae385a74e4ddaf301ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:47:15.685933 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-c3368d3d-94bd-4c12-90a6-a43f21c3e92f tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] 10.222.0.25 "GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f" status: 200 len: 1519 microversion: 2.1 time: 0.260126 May 27 03:47:15.686486 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 482/916] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:47:15 2021] GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f => generated 1519 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:47:16.370130 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-ce211eeb-b06b-411a-8f40-ff6bbfe77037 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:47:16.370729 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-ce211eeb-b06b-411a-8f40-ff6bbfe77037 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] [instance: 365c2ebc-713f-475e-a586-fa68bb6b3064] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:47:16.379084 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ce211eeb-b06b-411a-8f40-ff6bbfe77037 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:16.379581 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ce211eeb-b06b-411a-8f40-ff6bbfe77037 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:16.380373 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ce211eeb-b06b-411a-8f40-ff6bbfe77037 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:16.380848 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ce211eeb-b06b-411a-8f40-ff6bbfe77037 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:16.444908 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-ce211eeb-b06b-411a-8f40-ff6bbfe77037 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] [instance: 365c2ebc-713f-475e-a586-fa68bb6b3064] Going to try to terminate instance {{(pid=113021) delete /opt/stack/nova/nova/compute/api.py:2539}} May 27 03:47:16.702641 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-4e8a569d-112b-4cc9-a7ea-3772d1834430 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:47:16.703506 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-4e8a569d-112b-4cc9-a7ea-3772d1834430 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] [instance: 02984890-fe33-4d25-bf6d-a3c3163a965f] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:47:16.711245 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4e8a569d-112b-4cc9-a7ea-3772d1834430 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:16.711689 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4e8a569d-112b-4cc9-a7ea-3772d1834430 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:16.712524 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4e8a569d-112b-4cc9-a7ea-3772d1834430 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:16.712960 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4e8a569d-112b-4cc9-a7ea-3772d1834430 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:16.728179 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-ce211eeb-b06b-411a-8f40-ff6bbfe77037 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] 10.222.0.25 "DELETE /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064" status: 204 len: 0 microversion: 2.1 time: 0.361319 May 27 03:47:16.733534 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 435/917] 10.222.0.25 () {58 vars in 1239 bytes} [Thu May 27 03:47:16 2021] DELETE /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 03:47:16.738353 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-96cbd32e-bc46-4ca4-b9ae-192b7117b834 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:47:16.739076 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-96cbd32e-bc46-4ca4-b9ae-192b7117b834 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] [instance: 365c2ebc-713f-475e-a586-fa68bb6b3064] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:47:16.747457 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-96cbd32e-bc46-4ca4-b9ae-192b7117b834 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:16.747921 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-96cbd32e-bc46-4ca4-b9ae-192b7117b834 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:16.749013 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-96cbd32e-bc46-4ca4-b9ae-192b7117b834 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:16.749474 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-96cbd32e-bc46-4ca4-b9ae-192b7117b834 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:16.919008 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-4e8a569d-112b-4cc9-a7ea-3772d1834430 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023704e9bd7e4bfcace7a3fa2ec9d919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450ff0f7a98a4ae385a74e4ddaf301ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:47:16.927313 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-4e8a569d-112b-4cc9-a7ea-3772d1834430 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] 10.222.0.25 "GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f" status: 200 len: 1519 microversion: 2.1 time: 0.228356 May 27 03:47:16.927974 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 483/918] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:47:16 2021] GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f => generated 1519 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:47:16.951400 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-96cbd32e-bc46-4ca4-b9ae-192b7117b834 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71289d2497de4089bfcdae8474859196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dc5f669f3f483bacc0bf258a11c302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:47:16.960465 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-96cbd32e-bc46-4ca4-b9ae-192b7117b834 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] 10.222.0.25 "GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064" status: 200 len: 1513 microversion: 2.1 time: 0.226621 May 27 03:47:16.961178 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 436/919] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:47:16 2021] GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064 => generated 1513 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:47:17.944088 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-8ac7dcd5-4705-47ba-8ae4-2091459db59c tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:47:17.944746 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-8ac7dcd5-4705-47ba-8ae4-2091459db59c tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] [instance: 02984890-fe33-4d25-bf6d-a3c3163a965f] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:47:17.952012 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8ac7dcd5-4705-47ba-8ae4-2091459db59c tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:17.952502 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8ac7dcd5-4705-47ba-8ae4-2091459db59c tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:17.953277 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8ac7dcd5-4705-47ba-8ae4-2091459db59c tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:17.953722 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8ac7dcd5-4705-47ba-8ae4-2091459db59c tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:17.977798 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-c552c524-a1c3-423e-b379-a2cefb830c05 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:47:17.978414 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-c552c524-a1c3-423e-b379-a2cefb830c05 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] [instance: 365c2ebc-713f-475e-a586-fa68bb6b3064] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:47:17.985627 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c552c524-a1c3-423e-b379-a2cefb830c05 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:17.986707 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c552c524-a1c3-423e-b379-a2cefb830c05 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:17.987476 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c552c524-a1c3-423e-b379-a2cefb830c05 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:17.987916 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c552c524-a1c3-423e-b379-a2cefb830c05 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:18.147870 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-8ac7dcd5-4705-47ba-8ae4-2091459db59c tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023704e9bd7e4bfcace7a3fa2ec9d919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450ff0f7a98a4ae385a74e4ddaf301ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:47:18.155963 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-8ac7dcd5-4705-47ba-8ae4-2091459db59c tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] 10.222.0.25 "GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f" status: 200 len: 1575 microversion: 2.1 time: 0.215519 May 27 03:47:18.156823 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 484/920] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:47:17 2021] GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f => generated 1575 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:47:18.292018 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-c552c524-a1c3-423e-b379-a2cefb830c05 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71289d2497de4089bfcdae8474859196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dc5f669f3f483bacc0bf258a11c302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:47:18.300224 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-c552c524-a1c3-423e-b379-a2cefb830c05 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] 10.222.0.25 "GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064" status: 200 len: 1513 microversion: 2.1 time: 0.326046 May 27 03:47:18.300825 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 437/921] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:47:17 2021] GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064 => generated 1513 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:47:19.172719 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-fe75d0cf-7f06-4720-988a-152661d00835 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:47:19.173263 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-fe75d0cf-7f06-4720-988a-152661d00835 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] [instance: 02984890-fe33-4d25-bf6d-a3c3163a965f] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:47:19.181149 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-fe75d0cf-7f06-4720-988a-152661d00835 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:19.181605 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-fe75d0cf-7f06-4720-988a-152661d00835 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:19.182384 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-fe75d0cf-7f06-4720-988a-152661d00835 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:19.182831 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-fe75d0cf-7f06-4720-988a-152661d00835 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:19.318111 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-bd9546e1-0347-4816-8ad1-93c323b30673 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:47:19.318735 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-bd9546e1-0347-4816-8ad1-93c323b30673 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] [instance: 365c2ebc-713f-475e-a586-fa68bb6b3064] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:47:19.326752 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-bd9546e1-0347-4816-8ad1-93c323b30673 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:19.327198 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-bd9546e1-0347-4816-8ad1-93c323b30673 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:19.327984 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-bd9546e1-0347-4816-8ad1-93c323b30673 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:19.329348 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-bd9546e1-0347-4816-8ad1-93c323b30673 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:19.467785 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-fe75d0cf-7f06-4720-988a-152661d00835 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023704e9bd7e4bfcace7a3fa2ec9d919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450ff0f7a98a4ae385a74e4ddaf301ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:47:19.476649 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-fe75d0cf-7f06-4720-988a-152661d00835 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] 10.222.0.25 "GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f" status: 200 len: 1575 microversion: 2.1 time: 0.307700 May 27 03:47:19.477215 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 485/922] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:47:19 2021] GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f => generated 1575 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:47:19.703490 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-bd9546e1-0347-4816-8ad1-93c323b30673 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71289d2497de4089bfcdae8474859196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dc5f669f3f483bacc0bf258a11c302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:47:19.712235 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-bd9546e1-0347-4816-8ad1-93c323b30673 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] 10.222.0.25 "GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064" status: 200 len: 1513 microversion: 2.1 time: 0.398853 May 27 03:47:19.712826 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 438/923] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:47:19 2021] GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064 => generated 1513 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:47:19.957761 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [req-c33f50fc-011a-4951-909a-7d7f78856c50 req-e3e67f3e-7512-48fb-93be-92c3cc030511 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "365c2ebc-713f-475e-a586-fa68bb6b3064", "name": "network-vif-deleted", "tag": "490a8b44-4014-4b14-b088-dca46edd2c29"}]} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:47:19.959335 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:47:19.959335 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: warnings.warn(msg) May 27 03:47:19.975526 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-c33f50fc-011a-4951-909a-7d7f78856c50 req-e3e67f3e-7512-48fb-93be-92c3cc030511 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:19.975952 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-c33f50fc-011a-4951-909a-7d7f78856c50 req-e3e67f3e-7512-48fb-93be-92c3cc030511 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:19.991459 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.compute.server_external_events [req-c33f50fc-011a-4951-909a-7d7f78856c50 req-e3e67f3e-7512-48fb-93be-92c3cc030511 service nova] Creating event network-vif-deleted:490a8b44-4014-4b14-b088-dca46edd2c29 for instance 365c2ebc-713f-475e-a586-fa68bb6b3064 on hv-cinder-79326 May 27 03:47:19.996178 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [req-c33f50fc-011a-4951-909a-7d7f78856c50 req-e3e67f3e-7512-48fb-93be-92c3cc030511 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096966 May 27 03:47:19.996786 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 486/924] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:47:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:47:20.493116 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-cecf4f12-ff53-4c22-946d-7fa0f1cb4591 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:47:20.493733 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-cecf4f12-ff53-4c22-946d-7fa0f1cb4591 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] [instance: 02984890-fe33-4d25-bf6d-a3c3163a965f] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:47:20.501097 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-cecf4f12-ff53-4c22-946d-7fa0f1cb4591 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:20.501553 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-cecf4f12-ff53-4c22-946d-7fa0f1cb4591 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:20.502959 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-cecf4f12-ff53-4c22-946d-7fa0f1cb4591 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:20.503403 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-cecf4f12-ff53-4c22-946d-7fa0f1cb4591 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:20.696509 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-cecf4f12-ff53-4c22-946d-7fa0f1cb4591 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023704e9bd7e4bfcace7a3fa2ec9d919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450ff0f7a98a4ae385a74e4ddaf301ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:47:20.704846 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-cecf4f12-ff53-4c22-946d-7fa0f1cb4591 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] 10.222.0.25 "GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f" status: 200 len: 1575 microversion: 2.1 time: 0.215354 May 27 03:47:20.705401 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 439/925] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:47:20 2021] GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f => generated 1575 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:47:20.729683 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-f99d3ab2-90a2-4b07-9102-94426f4b59c7 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:47:20.730472 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-f99d3ab2-90a2-4b07-9102-94426f4b59c7 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] [instance: 365c2ebc-713f-475e-a586-fa68bb6b3064] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:47:20.738363 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f99d3ab2-90a2-4b07-9102-94426f4b59c7 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:20.738891 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f99d3ab2-90a2-4b07-9102-94426f4b59c7 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:20.739730 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f99d3ab2-90a2-4b07-9102-94426f4b59c7 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:20.740167 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f99d3ab2-90a2-4b07-9102-94426f4b59c7 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:20.808300 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f99d3ab2-90a2-4b07-9102-94426f4b59c7 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:20.808781 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f99d3ab2-90a2-4b07-9102-94426f4b59c7 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:20.809229 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.objects.instance [None req-f99d3ab2-90a2-4b07-9102-94426f4b59c7 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lazy-loading 'fault' on Instance uuid 365c2ebc-713f-475e-a586-fa68bb6b3064 {{(pid=113020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 27 03:47:20.867208 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-f99d3ab2-90a2-4b07-9102-94426f4b59c7 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71289d2497de4089bfcdae8474859196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dc5f669f3f483bacc0bf258a11c302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:47:20.875269 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-f99d3ab2-90a2-4b07-9102-94426f4b59c7 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] 10.222.0.25 "GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064" status: 200 len: 1309 microversion: 2.1 time: 0.149624 May 27 03:47:20.875836 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 487/926] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:47:20 2021] GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064 => generated 1309 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:47:21.721518 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-09980221-3270-462b-9b30-a38e42ff7d9e tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:47:21.722080 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-09980221-3270-462b-9b30-a38e42ff7d9e tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] [instance: 02984890-fe33-4d25-bf6d-a3c3163a965f] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:47:21.729473 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-09980221-3270-462b-9b30-a38e42ff7d9e tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:21.729926 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-09980221-3270-462b-9b30-a38e42ff7d9e tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:21.730702 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-09980221-3270-462b-9b30-a38e42ff7d9e tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:21.731143 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-09980221-3270-462b-9b30-a38e42ff7d9e tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:21.890812 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-1fa7f43f-154c-46d5-a38c-ebaaab0f760e tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:47:21.891512 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-1fa7f43f-154c-46d5-a38c-ebaaab0f760e tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] [instance: 365c2ebc-713f-475e-a586-fa68bb6b3064] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:47:21.899296 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1fa7f43f-154c-46d5-a38c-ebaaab0f760e tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:21.899814 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1fa7f43f-154c-46d5-a38c-ebaaab0f760e tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:21.900680 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1fa7f43f-154c-46d5-a38c-ebaaab0f760e tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:21.901117 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1fa7f43f-154c-46d5-a38c-ebaaab0f760e tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:21.922250 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-09980221-3270-462b-9b30-a38e42ff7d9e tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023704e9bd7e4bfcace7a3fa2ec9d919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450ff0f7a98a4ae385a74e4ddaf301ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:47:21.931008 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-09980221-3270-462b-9b30-a38e42ff7d9e tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] 10.222.0.25 "GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f" status: 200 len: 1575 microversion: 2.1 time: 0.213316 May 27 03:47:21.931580 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 440/927] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:47:21 2021] GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f => generated 1575 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:47:21.949814 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.wsgi [None req-1fa7f43f-154c-46d5-a38c-ebaaab0f760e tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] HTTP exception thrown: Instance 365c2ebc-713f-475e-a586-fa68bb6b3064 could not be found. May 27 03:47:21.950413 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-1fa7f43f-154c-46d5-a38c-ebaaab0f760e tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Returning 404 to user: Instance 365c2ebc-713f-475e-a586-fa68bb6b3064 could not be found. {{(pid=113020) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 27 03:47:21.951231 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-1fa7f43f-154c-46d5-a38c-ebaaab0f760e tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] 10.222.0.25 "GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064" status: 404 len: 111 microversion: 2.1 time: 0.064140 May 27 03:47:21.951761 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 488/928] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:47:21 2021] GET /compute/v2.1/servers/365c2ebc-713f-475e-a586-fa68bb6b3064 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 03:47:22.948256 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-48a69a2d-14aa-48ac-b565-272d501d53ad tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:47:22.948903 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-48a69a2d-14aa-48ac-b565-272d501d53ad tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] [instance: 02984890-fe33-4d25-bf6d-a3c3163a965f] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:47:22.956760 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-48a69a2d-14aa-48ac-b565-272d501d53ad tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:22.957213 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-48a69a2d-14aa-48ac-b565-272d501d53ad tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:22.957975 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-48a69a2d-14aa-48ac-b565-272d501d53ad tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:22.958410 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-48a69a2d-14aa-48ac-b565-272d501d53ad tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:23.153737 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-48a69a2d-14aa-48ac-b565-272d501d53ad tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023704e9bd7e4bfcace7a3fa2ec9d919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450ff0f7a98a4ae385a74e4ddaf301ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:47:23.162148 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-48a69a2d-14aa-48ac-b565-272d501d53ad tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] 10.222.0.25 "GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f" status: 200 len: 1575 microversion: 2.1 time: 0.217551 May 27 03:47:23.162704 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 441/929] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:47:22 2021] GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f => generated 1575 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:47:24.178913 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-74c2b82b-b068-48d0-9942-fd81daff1f54 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:47:24.179475 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-74c2b82b-b068-48d0-9942-fd81daff1f54 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] [instance: 02984890-fe33-4d25-bf6d-a3c3163a965f] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:47:24.186710 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-74c2b82b-b068-48d0-9942-fd81daff1f54 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:24.187167 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-74c2b82b-b068-48d0-9942-fd81daff1f54 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:24.187939 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-74c2b82b-b068-48d0-9942-fd81daff1f54 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:24.188381 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-74c2b82b-b068-48d0-9942-fd81daff1f54 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:24.383835 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-74c2b82b-b068-48d0-9942-fd81daff1f54 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023704e9bd7e4bfcace7a3fa2ec9d919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450ff0f7a98a4ae385a74e4ddaf301ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:47:24.391971 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-74c2b82b-b068-48d0-9942-fd81daff1f54 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] 10.222.0.25 "GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f" status: 200 len: 1575 microversion: 2.1 time: 0.216990 May 27 03:47:24.393058 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 489/930] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:47:24 2021] GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f => generated 1575 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:47:25.409815 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-fd4e135d-c979-4a68-8f02-4d5c897e6dd2 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:47:25.414703 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-fd4e135d-c979-4a68-8f02-4d5c897e6dd2 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] [instance: 02984890-fe33-4d25-bf6d-a3c3163a965f] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:47:25.418543 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-fd4e135d-c979-4a68-8f02-4d5c897e6dd2 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:25.418991 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-fd4e135d-c979-4a68-8f02-4d5c897e6dd2 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:25.419755 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-fd4e135d-c979-4a68-8f02-4d5c897e6dd2 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:25.420189 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-fd4e135d-c979-4a68-8f02-4d5c897e6dd2 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:25.611093 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-fd4e135d-c979-4a68-8f02-4d5c897e6dd2 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023704e9bd7e4bfcace7a3fa2ec9d919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450ff0f7a98a4ae385a74e4ddaf301ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:47:25.619387 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-fd4e135d-c979-4a68-8f02-4d5c897e6dd2 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] 10.222.0.25 "GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f" status: 200 len: 1575 microversion: 2.1 time: 0.213723 May 27 03:47:25.619966 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 442/931] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:47:25 2021] GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f => generated 1575 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:47:26.636427 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-5a0f6f77-9517-4437-9091-8c16f3435abf tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:47:26.637058 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-5a0f6f77-9517-4437-9091-8c16f3435abf tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] [instance: 02984890-fe33-4d25-bf6d-a3c3163a965f] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:47:26.644285 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-5a0f6f77-9517-4437-9091-8c16f3435abf tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:26.645257 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-5a0f6f77-9517-4437-9091-8c16f3435abf tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:26.646064 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-5a0f6f77-9517-4437-9091-8c16f3435abf tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:26.646531 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-5a0f6f77-9517-4437-9091-8c16f3435abf tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:26.836520 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-5a0f6f77-9517-4437-9091-8c16f3435abf tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023704e9bd7e4bfcace7a3fa2ec9d919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450ff0f7a98a4ae385a74e4ddaf301ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:47:26.844597 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-5a0f6f77-9517-4437-9091-8c16f3435abf tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] 10.222.0.25 "GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f" status: 200 len: 1575 microversion: 2.1 time: 0.211810 May 27 03:47:26.845170 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 490/932] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:47:26 2021] GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f => generated 1575 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:47:27.861353 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-f0f188b9-65a7-4020-a23f-2c500c28b519 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:47:27.861916 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-f0f188b9-65a7-4020-a23f-2c500c28b519 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] [instance: 02984890-fe33-4d25-bf6d-a3c3163a965f] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:47:27.870454 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f0f188b9-65a7-4020-a23f-2c500c28b519 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:27.870914 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f0f188b9-65a7-4020-a23f-2c500c28b519 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:27.871694 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f0f188b9-65a7-4020-a23f-2c500c28b519 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:27.872139 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f0f188b9-65a7-4020-a23f-2c500c28b519 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:28.074167 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-f0f188b9-65a7-4020-a23f-2c500c28b519 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023704e9bd7e4bfcace7a3fa2ec9d919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450ff0f7a98a4ae385a74e4ddaf301ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:47:28.082280 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-f0f188b9-65a7-4020-a23f-2c500c28b519 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] 10.222.0.25 "GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f" status: 200 len: 1575 microversion: 2.1 time: 0.224686 May 27 03:47:28.082836 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 443/933] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:47:27 2021] GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f => generated 1575 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:47:29.099455 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-73d42a7e-7dc6-46df-ab05-779c235cbcd5 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:47:29.100103 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-73d42a7e-7dc6-46df-ab05-779c235cbcd5 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] [instance: 02984890-fe33-4d25-bf6d-a3c3163a965f] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:47:29.108314 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-73d42a7e-7dc6-46df-ab05-779c235cbcd5 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:29.108831 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-73d42a7e-7dc6-46df-ab05-779c235cbcd5 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:29.109639 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-73d42a7e-7dc6-46df-ab05-779c235cbcd5 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:29.110084 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-73d42a7e-7dc6-46df-ab05-779c235cbcd5 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:29.310960 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-73d42a7e-7dc6-46df-ab05-779c235cbcd5 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023704e9bd7e4bfcace7a3fa2ec9d919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450ff0f7a98a4ae385a74e4ddaf301ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:47:29.319858 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-73d42a7e-7dc6-46df-ab05-779c235cbcd5 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] 10.222.0.25 "GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f" status: 200 len: 1575 microversion: 2.1 time: 0.224303 May 27 03:47:29.323114 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 491/934] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:47:29 2021] GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f => generated 1575 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:47:30.335868 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-f59cbe6d-83c9-4160-83a1-92a72f4723c5 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:47:30.336520 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-f59cbe6d-83c9-4160-83a1-92a72f4723c5 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] [instance: 02984890-fe33-4d25-bf6d-a3c3163a965f] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:47:30.343768 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f59cbe6d-83c9-4160-83a1-92a72f4723c5 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:30.344219 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f59cbe6d-83c9-4160-83a1-92a72f4723c5 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:30.345019 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f59cbe6d-83c9-4160-83a1-92a72f4723c5 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:30.345468 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f59cbe6d-83c9-4160-83a1-92a72f4723c5 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:30.543992 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-f59cbe6d-83c9-4160-83a1-92a72f4723c5 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023704e9bd7e4bfcace7a3fa2ec9d919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450ff0f7a98a4ae385a74e4ddaf301ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:47:30.552171 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-f59cbe6d-83c9-4160-83a1-92a72f4723c5 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] 10.222.0.25 "GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f" status: 200 len: 1575 microversion: 2.1 time: 0.220455 May 27 03:47:30.552777 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 444/935] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:47:30 2021] GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f => generated 1575 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:47:31.569072 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-098929b9-a7b3-4a8a-af7a-5af51c8fd0c5 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:47:31.569584 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-098929b9-a7b3-4a8a-af7a-5af51c8fd0c5 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] [instance: 02984890-fe33-4d25-bf6d-a3c3163a965f] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:47:31.576974 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-098929b9-a7b3-4a8a-af7a-5af51c8fd0c5 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:31.577428 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-098929b9-a7b3-4a8a-af7a-5af51c8fd0c5 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:31.578198 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-098929b9-a7b3-4a8a-af7a-5af51c8fd0c5 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:31.578644 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-098929b9-a7b3-4a8a-af7a-5af51c8fd0c5 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:31.774259 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-098929b9-a7b3-4a8a-af7a-5af51c8fd0c5 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023704e9bd7e4bfcace7a3fa2ec9d919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450ff0f7a98a4ae385a74e4ddaf301ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:47:31.782301 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-098929b9-a7b3-4a8a-af7a-5af51c8fd0c5 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] 10.222.0.25 "GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f" status: 200 len: 1575 microversion: 2.1 time: 0.217011 May 27 03:47:31.782854 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 492/936] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:47:31 2021] GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f => generated 1575 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:47:32.799614 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-0287f467-9d32-418c-8398-d09a51ee89d4 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:47:32.800234 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-0287f467-9d32-418c-8398-d09a51ee89d4 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] [instance: 02984890-fe33-4d25-bf6d-a3c3163a965f] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:47:32.808233 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-0287f467-9d32-418c-8398-d09a51ee89d4 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:32.808726 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-0287f467-9d32-418c-8398-d09a51ee89d4 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:32.809500 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-0287f467-9d32-418c-8398-d09a51ee89d4 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:32.809941 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-0287f467-9d32-418c-8398-d09a51ee89d4 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:32.997266 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-0287f467-9d32-418c-8398-d09a51ee89d4 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023704e9bd7e4bfcace7a3fa2ec9d919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450ff0f7a98a4ae385a74e4ddaf301ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:47:33.005429 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-0287f467-9d32-418c-8398-d09a51ee89d4 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] 10.222.0.25 "GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f" status: 200 len: 1575 microversion: 2.1 time: 0.209525 May 27 03:47:33.005987 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 445/937] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:47:32 2021] GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f => generated 1575 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:47:34.022250 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-f630d262-11c0-45fb-b706-93d940b5ab91 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:47:34.022855 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-f630d262-11c0-45fb-b706-93d940b5ab91 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] [instance: 02984890-fe33-4d25-bf6d-a3c3163a965f] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:47:34.030148 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f630d262-11c0-45fb-b706-93d940b5ab91 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:34.030598 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f630d262-11c0-45fb-b706-93d940b5ab91 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:34.031357 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f630d262-11c0-45fb-b706-93d940b5ab91 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:34.031791 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f630d262-11c0-45fb-b706-93d940b5ab91 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:34.220837 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-f630d262-11c0-45fb-b706-93d940b5ab91 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023704e9bd7e4bfcace7a3fa2ec9d919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450ff0f7a98a4ae385a74e4ddaf301ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:47:34.229497 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-f630d262-11c0-45fb-b706-93d940b5ab91 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] 10.222.0.25 "GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f" status: 200 len: 1575 microversion: 2.1 time: 0.210943 May 27 03:47:34.230054 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 493/938] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:47:34 2021] GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f => generated 1575 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:47:34.883467 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-ce55ad91-86ac-4d28-b645-fe6fce5ad0b0 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1611369771", "imageRef": "78c0913d-0e41-4b41-b38f-f45c4f2535ff", "flavorRef": "452", "networks": [{"uuid": "fcc8c911-2569-47b8-92dc-e0c1b7c0a740"}]}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:47:34.946760 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.network.neutron [None req-ce55ad91-86ac-4d28-b645-fe6fce5ad0b0 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] validate_networks() for [('fcc8c911-2569-47b8-92dc-e0c1b7c0a740', None, None, None)] {{(pid=113021) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 27 03:47:35.246431 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-93f05f5e-bed4-4f42-a194-586c57e028f9 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:47:35.247051 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-93f05f5e-bed4-4f42-a194-586c57e028f9 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] [instance: 02984890-fe33-4d25-bf6d-a3c3163a965f] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:47:35.254228 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-93f05f5e-bed4-4f42-a194-586c57e028f9 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:35.254686 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-93f05f5e-bed4-4f42-a194-586c57e028f9 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:35.255994 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-93f05f5e-bed4-4f42-a194-586c57e028f9 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:35.256375 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-93f05f5e-bed4-4f42-a194-586c57e028f9 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:35.465776 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-93f05f5e-bed4-4f42-a194-586c57e028f9 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023704e9bd7e4bfcace7a3fa2ec9d919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450ff0f7a98a4ae385a74e4ddaf301ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:47:35.474514 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-93f05f5e-bed4-4f42-a194-586c57e028f9 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] 10.222.0.25 "GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f" status: 200 len: 1575 microversion: 2.1 time: 0.231675 May 27 03:47:35.475099 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 494/939] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:47:35 2021] GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f => generated 1575 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:47:35.626750 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.virt.hardware [None req-ce55ad91-86ac-4d28-b645-fe6fce5ad0b0 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Flavor limits 0:0:0 {{(pid=113021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 27 03:47:35.627247 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.virt.hardware [None req-ce55ad91-86ac-4d28-b645-fe6fce5ad0b0 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Image limits 0:0:0 {{(pid=113021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 27 03:47:35.627801 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.virt.hardware [None req-ce55ad91-86ac-4d28-b645-fe6fce5ad0b0 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Flavor pref 0:0:0 {{(pid=113021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 27 03:47:35.628281 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.virt.hardware [None req-ce55ad91-86ac-4d28-b645-fe6fce5ad0b0 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Image pref 0:0:0 {{(pid=113021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 27 03:47:35.628855 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.virt.hardware [None req-ce55ad91-86ac-4d28-b645-fe6fce5ad0b0 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=113021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 27 03:47:35.638080 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ce55ad91-86ac-4d28-b645-fe6fce5ad0b0 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:35.638542 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ce55ad91-86ac-4d28-b645-fe6fce5ad0b0 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:35.639346 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ce55ad91-86ac-4d28-b645-fe6fce5ad0b0 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:35.639786 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ce55ad91-86ac-4d28-b645-fe6fce5ad0b0 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:35.657469 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.quota [None req-ce55ad91-86ac-4d28-b645-fe6fce5ad0b0 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Getting quotas for project 00dc5f669f3f483bacc0bf258a11c302. Resources: {'instances', 'cores', 'ram'} {{(pid=113021) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 27 03:47:35.662211 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.quota [None req-ce55ad91-86ac-4d28-b645-fe6fce5ad0b0 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Getting quotas for user 71289d2497de4089bfcdae8474859196 and project 00dc5f669f3f483bacc0bf258a11c302. Resources: {'instances', 'cores', 'ram'} {{(pid=113021) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 27 03:47:35.672909 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-ce55ad91-86ac-4d28-b645-fe6fce5ad0b0 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Going to run 1 instances... {{(pid=113021) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 27 03:47:35.675266 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-ce55ad91-86ac-4d28-b645-fe6fce5ad0b0 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] [instance: d3834ee5-6837-4b8d-abb2-0c048ef2d2e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78c0913d-0e41-4b41-b38f-f45c4f2535ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=113021) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 27 03:47:35.753675 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [req-d4689a14-b2ae-4d6a-802a-2857f75c1249 req-28631829-ea23-46c1-8f40-2f414b7ac0a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02984890-fe33-4d25-bf6d-a3c3163a965f", "name": "network-vif-plugged", "status": "completed", "tag": "2554297d-a794-4bc9-9cb3-56dce4e9fb2f"}]} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:47:35.759278 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:47:35.759278 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: warnings.warn(msg) May 27 03:47:35.763250 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-d4689a14-b2ae-4d6a-802a-2857f75c1249 req-28631829-ea23-46c1-8f40-2f414b7ac0a0 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:35.763692 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-d4689a14-b2ae-4d6a-802a-2857f75c1249 req-28631829-ea23-46c1-8f40-2f414b7ac0a0 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:35.778812 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.compute.server_external_events [req-d4689a14-b2ae-4d6a-802a-2857f75c1249 req-28631829-ea23-46c1-8f40-2f414b7ac0a0 service nova] Creating event network-vif-plugged:2554297d-a794-4bc9-9cb3-56dce4e9fb2f for instance 02984890-fe33-4d25-bf6d-a3c3163a965f on hv-cinder-79326 May 27 03:47:35.783663 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [req-d4689a14-b2ae-4d6a-802a-2857f75c1249 req-28631829-ea23-46c1-8f40-2f414b7ac0a0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033645 May 27 03:47:35.787961 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 495/940] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:47:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:47:35.793867 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-ce55ad91-86ac-4d28-b645-fe6fce5ad0b0 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.913945 May 27 03:47:35.794508 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 446/941] 10.222.0.25 () {60 vars in 1147 bytes} [Thu May 27 03:47:34 2021] POST /compute/v2.1/servers => generated 380 bytes in 915 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 03:47:35.805404 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-1fccf03c-d48d-430b-8b31-dce8afac6bea tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:47:35.806104 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-1fccf03c-d48d-430b-8b31-dce8afac6bea tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] [instance: d3834ee5-6837-4b8d-abb2-0c048ef2d2e5] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:47:35.878521 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-1fccf03c-d48d-430b-8b31-dce8afac6bea tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71289d2497de4089bfcdae8474859196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dc5f669f3f483bacc0bf258a11c302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:47:35.886942 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-1fccf03c-d48d-430b-8b31-dce8afac6bea tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] 10.222.0.25 "GET /compute/v2.1/servers/d3834ee5-6837-4b8d-abb2-0c048ef2d2e5" status: 200 len: 1219 microversion: 2.1 time: 0.086334 May 27 03:47:35.887584 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 496/942] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:47:35 2021] GET /compute/v2.1/servers/d3834ee5-6837-4b8d-abb2-0c048ef2d2e5 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:47:36.492042 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-e0299a8b-7a11-49da-8963-f8feecfd935d tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:47:36.492706 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-e0299a8b-7a11-49da-8963-f8feecfd935d tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] [instance: 02984890-fe33-4d25-bf6d-a3c3163a965f] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:47:36.500375 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e0299a8b-7a11-49da-8963-f8feecfd935d tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:36.500854 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e0299a8b-7a11-49da-8963-f8feecfd935d tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:36.501629 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e0299a8b-7a11-49da-8963-f8feecfd935d tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:36.502076 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e0299a8b-7a11-49da-8963-f8feecfd935d tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:36.701019 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-e0299a8b-7a11-49da-8963-f8feecfd935d tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023704e9bd7e4bfcace7a3fa2ec9d919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450ff0f7a98a4ae385a74e4ddaf301ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:47:36.709406 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-e0299a8b-7a11-49da-8963-f8feecfd935d tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] 10.222.0.25 "GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f" status: 200 len: 1575 microversion: 2.1 time: 0.221657 May 27 03:47:36.709912 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 447/943] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:47:36 2021] GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f => generated 1575 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:47:36.903421 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-e73e96c8-af23-4774-a7a2-9c2f64d8b84b tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:47:36.904103 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-e73e96c8-af23-4774-a7a2-9c2f64d8b84b tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] [instance: d3834ee5-6837-4b8d-abb2-0c048ef2d2e5] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:47:36.912999 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e73e96c8-af23-4774-a7a2-9c2f64d8b84b tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:36.913447 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e73e96c8-af23-4774-a7a2-9c2f64d8b84b tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:36.914214 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e73e96c8-af23-4774-a7a2-9c2f64d8b84b tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:36.914650 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e73e96c8-af23-4774-a7a2-9c2f64d8b84b tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:37.028559 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-e73e96c8-af23-4774-a7a2-9c2f64d8b84b tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71289d2497de4089bfcdae8474859196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dc5f669f3f483bacc0bf258a11c302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:47:37.034080 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-e73e96c8-af23-4774-a7a2-9c2f64d8b84b tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] 10.222.0.25 "GET /compute/v2.1/servers/d3834ee5-6837-4b8d-abb2-0c048ef2d2e5" status: 200 len: 1215 microversion: 2.1 time: 0.134413 May 27 03:47:37.034650 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 497/944] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:47:36 2021] GET /compute/v2.1/servers/d3834ee5-6837-4b8d-abb2-0c048ef2d2e5 => generated 1215 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:47:37.835041 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-420f471b-b9d8-46ee-92d3-3594afc143ee tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:47:37.835583 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-420f471b-b9d8-46ee-92d3-3594afc143ee tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:47:37.845270 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-420f471b-b9d8-46ee-92d3-3594afc143ee tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:37.846264 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-420f471b-b9d8-46ee-92d3-3594afc143ee tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:37.847244 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-420f471b-b9d8-46ee-92d3-3594afc143ee tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:37.848592 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-420f471b-b9d8-46ee-92d3-3594afc143ee tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:37.866610 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-34710539-e8f5-4e96-9f32-09423ce68dc7 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:47:37.867285 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-34710539-e8f5-4e96-9f32-09423ce68dc7 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] [instance: 02984890-fe33-4d25-bf6d-a3c3163a965f] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:47:37.874973 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-34710539-e8f5-4e96-9f32-09423ce68dc7 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:37.875421 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-34710539-e8f5-4e96-9f32-09423ce68dc7 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:37.876191 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-34710539-e8f5-4e96-9f32-09423ce68dc7 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:37.876659 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-34710539-e8f5-4e96-9f32-09423ce68dc7 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:38.024134 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.objects.instance [None req-420f471b-b9d8-46ee-92d3-3594afc143ee tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lazy-loading 'services' on Instance uuid 3c7e656a-afc5-4119-a11e-920c583d89d2 {{(pid=113021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 27 03:47:38.082268 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-34710539-e8f5-4e96-9f32-09423ce68dc7 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023704e9bd7e4bfcace7a3fa2ec9d919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450ff0f7a98a4ae385a74e4ddaf301ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:47:38.090947 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-34710539-e8f5-4e96-9f32-09423ce68dc7 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] 10.222.0.25 "GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f" status: 200 len: 1562 microversion: 2.1 time: 0.368499 May 27 03:47:38.091654 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 498/945] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:47:37 2021] GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f => generated 1562 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:47:38.120124 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-01f3b3a8-92ef-46d9-8654-4e1944c623f2 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:47:38.120771 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-01f3b3a8-92ef-46d9-8654-4e1944c623f2 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] [instance: d3834ee5-6837-4b8d-abb2-0c048ef2d2e5] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:47:38.129125 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-01f3b3a8-92ef-46d9-8654-4e1944c623f2 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:38.129590 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-01f3b3a8-92ef-46d9-8654-4e1944c623f2 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:38.130494 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-01f3b3a8-92ef-46d9-8654-4e1944c623f2 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:38.130941 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-01f3b3a8-92ef-46d9-8654-4e1944c623f2 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:38.244215 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-01f3b3a8-92ef-46d9-8654-4e1944c623f2 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71289d2497de4089bfcdae8474859196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dc5f669f3f483bacc0bf258a11c302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:47:38.252396 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-01f3b3a8-92ef-46d9-8654-4e1944c623f2 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] 10.222.0.25 "GET /compute/v2.1/servers/d3834ee5-6837-4b8d-abb2-0c048ef2d2e5" status: 200 len: 1277 microversion: 2.1 time: 0.149007 May 27 03:47:38.252981 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 499/946] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:47:38 2021] GET /compute/v2.1/servers/d3834ee5-6837-4b8d-abb2-0c048ef2d2e5 => generated 1277 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:47:38.293356 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-420f471b-b9d8-46ee-92d3-3594afc143ee tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/os-volume_attachments/b9add35f-03ae-4e56-a5ab-5c4940e04ba8" status: 202 len: 0 microversion: 2.1 time: 0.594508 May 27 03:47:38.293955 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 448/947] 10.222.0.25 () {58 vars in 1416 bytes} [Thu May 27 03:47:37 2021] DELETE /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/os-volume_attachments/b9add35f-03ae-4e56-a5ab-5c4940e04ba8 => generated 0 bytes in 596 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:47:39.269944 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-dfcd058a-8415-4123-927a-783796600a80 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:47:39.270559 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-dfcd058a-8415-4123-927a-783796600a80 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] [instance: d3834ee5-6837-4b8d-abb2-0c048ef2d2e5] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:47:39.277924 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-dfcd058a-8415-4123-927a-783796600a80 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:39.278375 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-dfcd058a-8415-4123-927a-783796600a80 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:39.279149 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-dfcd058a-8415-4123-927a-783796600a80 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:39.279586 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-dfcd058a-8415-4123-927a-783796600a80 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:39.491370 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-dfcd058a-8415-4123-927a-783796600a80 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71289d2497de4089bfcdae8474859196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dc5f669f3f483bacc0bf258a11c302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:47:39.500535 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-dfcd058a-8415-4123-927a-783796600a80 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] 10.222.0.25 "GET /compute/v2.1/servers/d3834ee5-6837-4b8d-abb2-0c048ef2d2e5" status: 200 len: 1319 microversion: 2.1 time: 0.235562 May 27 03:47:39.501252 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 500/948] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:47:39 2021] GET /compute/v2.1/servers/d3834ee5-6837-4b8d-abb2-0c048ef2d2e5 => generated 1319 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:47:39.842576 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [req-ef97fba1-1094-4c6e-8609-db16054004e5 req-0ae4309e-0ece-4af4-8ec2-e0311b2c5c9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3834ee5-6837-4b8d-abb2-0c048ef2d2e5", "tag": "d711e7b6-b731-4377-8814-b74e7863713f"}]} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:47:39.844935 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:47:39.844935 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: warnings.warn(msg) May 27 03:47:39.857698 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-ef97fba1-1094-4c6e-8609-db16054004e5 req-0ae4309e-0ece-4af4-8ec2-e0311b2c5c9a service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:39.858152 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-ef97fba1-1094-4c6e-8609-db16054004e5 req-0ae4309e-0ece-4af4-8ec2-e0311b2c5c9a service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:39.873609 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.compute.server_external_events [req-ef97fba1-1094-4c6e-8609-db16054004e5 req-0ae4309e-0ece-4af4-8ec2-e0311b2c5c9a service nova] Creating event network-changed:d711e7b6-b731-4377-8814-b74e7863713f for instance d3834ee5-6837-4b8d-abb2-0c048ef2d2e5 on hv-cinder-79326 May 27 03:47:39.878270 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [req-ef97fba1-1094-4c6e-8609-db16054004e5 req-0ae4309e-0ece-4af4-8ec2-e0311b2c5c9a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039690 May 27 03:47:39.878843 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 449/949] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:47:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:47:40.517480 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-df5602a1-49e1-451c-ad2c-57df4c81cb01 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:47:40.518134 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-df5602a1-49e1-451c-ad2c-57df4c81cb01 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] [instance: d3834ee5-6837-4b8d-abb2-0c048ef2d2e5] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:47:40.525999 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-df5602a1-49e1-451c-ad2c-57df4c81cb01 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:40.526454 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-df5602a1-49e1-451c-ad2c-57df4c81cb01 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:40.527223 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-df5602a1-49e1-451c-ad2c-57df4c81cb01 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:40.527795 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-df5602a1-49e1-451c-ad2c-57df4c81cb01 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:40.596926 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-8f427dd4-acc8-4cc0-8b33-e41cff18e625 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:47:40.604313 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8f427dd4-acc8-4cc0-8b33-e41cff18e625 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:40.604795 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8f427dd4-acc8-4cc0-8b33-e41cff18e625 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:40.660762 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-8f427dd4-acc8-4cc0-8b33-e41cff18e625 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Going to try to stop instance {{(pid=113021) force_stop /opt/stack/nova/nova/compute/api.py:2579}} May 27 03:47:40.732746 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-df5602a1-49e1-451c-ad2c-57df4c81cb01 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71289d2497de4089bfcdae8474859196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dc5f669f3f483bacc0bf258a11c302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:47:40.741073 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-df5602a1-49e1-451c-ad2c-57df4c81cb01 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] 10.222.0.25 "GET /compute/v2.1/servers/d3834ee5-6837-4b8d-abb2-0c048ef2d2e5" status: 200 len: 1319 microversion: 2.1 time: 0.227536 May 27 03:47:40.741959 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 501/950] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:47:40 2021] GET /compute/v2.1/servers/d3834ee5-6837-4b8d-abb2-0c048ef2d2e5 => generated 1319 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:47:40.874014 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-8f427dd4-acc8-4cc0-8b33-e41cff18e625 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 202 len: 0 microversion: 2.1 time: 0.280546 May 27 03:47:40.874657 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 450/951] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:47:40 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 27 03:47:40.882789 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-63ccc4bc-9e41-4d64-b4af-93e1fabb4726 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:47:40.883580 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-63ccc4bc-9e41-4d64-b4af-93e1fabb4726 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:47:40.890975 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-63ccc4bc-9e41-4d64-b4af-93e1fabb4726 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:40.893109 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-63ccc4bc-9e41-4d64-b4af-93e1fabb4726 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:40.893109 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-63ccc4bc-9e41-4d64-b4af-93e1fabb4726 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:40.893109 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-63ccc4bc-9e41-4d64-b4af-93e1fabb4726 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:41.082625 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-63ccc4bc-9e41-4d64-b4af-93e1fabb4726 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:47:41.091314 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-63ccc4bc-9e41-4d64-b4af-93e1fabb4726 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1677 microversion: 2.1 time: 0.212256 May 27 03:47:41.091863 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 502/952] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:47:40 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1677 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:47:41.758708 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-3ba1600d-0702-40d2-be0f-501f73d116d0 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:47:41.759442 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-3ba1600d-0702-40d2-be0f-501f73d116d0 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] [instance: d3834ee5-6837-4b8d-abb2-0c048ef2d2e5] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:47:41.766847 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-3ba1600d-0702-40d2-be0f-501f73d116d0 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:41.767303 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-3ba1600d-0702-40d2-be0f-501f73d116d0 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:41.768071 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-3ba1600d-0702-40d2-be0f-501f73d116d0 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:41.768540 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-3ba1600d-0702-40d2-be0f-501f73d116d0 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:42.066779 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-3ba1600d-0702-40d2-be0f-501f73d116d0 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71289d2497de4089bfcdae8474859196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dc5f669f3f483bacc0bf258a11c302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:47:42.075452 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-3ba1600d-0702-40d2-be0f-501f73d116d0 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] 10.222.0.25 "GET /compute/v2.1/servers/d3834ee5-6837-4b8d-abb2-0c048ef2d2e5" status: 200 len: 1319 microversion: 2.1 time: 0.321415 May 27 03:47:42.076020 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 451/953] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:47:41 2021] GET /compute/v2.1/servers/d3834ee5-6837-4b8d-abb2-0c048ef2d2e5 => generated 1319 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:47:42.108508 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-6ddc24a2-bdd2-4f90-bcb8-b8cc043dc30a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:47:42.109121 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-6ddc24a2-bdd2-4f90-bcb8-b8cc043dc30a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:47:42.116832 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6ddc24a2-bdd2-4f90-bcb8-b8cc043dc30a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:42.117280 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6ddc24a2-bdd2-4f90-bcb8-b8cc043dc30a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:42.118044 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6ddc24a2-bdd2-4f90-bcb8-b8cc043dc30a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:42.118483 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6ddc24a2-bdd2-4f90-bcb8-b8cc043dc30a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:42.313602 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-6ddc24a2-bdd2-4f90-bcb8-b8cc043dc30a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:47:42.322254 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-6ddc24a2-bdd2-4f90-bcb8-b8cc043dc30a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1677 microversion: 2.1 time: 0.217409 May 27 03:47:42.322814 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 503/954] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:47:42 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1677 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:47:43.090876 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-6778413b-d927-4bba-a0b1-e84ce59bc17b tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:47:43.091423 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-6778413b-d927-4bba-a0b1-e84ce59bc17b tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] [instance: d3834ee5-6837-4b8d-abb2-0c048ef2d2e5] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:47:43.099271 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6778413b-d927-4bba-a0b1-e84ce59bc17b tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:43.099725 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6778413b-d927-4bba-a0b1-e84ce59bc17b tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:43.100517 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6778413b-d927-4bba-a0b1-e84ce59bc17b tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:43.100955 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6778413b-d927-4bba-a0b1-e84ce59bc17b tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:43.290137 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-6778413b-d927-4bba-a0b1-e84ce59bc17b tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71289d2497de4089bfcdae8474859196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dc5f669f3f483bacc0bf258a11c302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:47:43.298213 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-6778413b-d927-4bba-a0b1-e84ce59bc17b tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] 10.222.0.25 "GET /compute/v2.1/servers/d3834ee5-6837-4b8d-abb2-0c048ef2d2e5" status: 200 len: 1319 microversion: 2.1 time: 0.211045 May 27 03:47:43.298779 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 452/955] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:47:43 2021] GET /compute/v2.1/servers/d3834ee5-6837-4b8d-abb2-0c048ef2d2e5 => generated 1319 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:47:43.339569 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-0b344bfd-9016-4ec8-a9f5-d746f49b19fe tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:47:43.340181 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-0b344bfd-9016-4ec8-a9f5-d746f49b19fe tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:47:43.347478 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0b344bfd-9016-4ec8-a9f5-d746f49b19fe tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:43.347870 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0b344bfd-9016-4ec8-a9f5-d746f49b19fe tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:43.348705 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0b344bfd-9016-4ec8-a9f5-d746f49b19fe tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:43.349140 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0b344bfd-9016-4ec8-a9f5-d746f49b19fe tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:43.539481 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-0b344bfd-9016-4ec8-a9f5-d746f49b19fe tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:47:43.547487 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-0b344bfd-9016-4ec8-a9f5-d746f49b19fe tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1677 microversion: 2.1 time: 0.211568 May 27 03:47:43.548043 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 504/956] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:47:43 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1677 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:47:44.314650 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-edd53c50-9729-48fa-aa53-51b9cb3941f1 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:47:44.315261 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-edd53c50-9729-48fa-aa53-51b9cb3941f1 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] [instance: d3834ee5-6837-4b8d-abb2-0c048ef2d2e5] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:47:44.323100 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-edd53c50-9729-48fa-aa53-51b9cb3941f1 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:44.323546 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-edd53c50-9729-48fa-aa53-51b9cb3941f1 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:44.324309 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-edd53c50-9729-48fa-aa53-51b9cb3941f1 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:44.324771 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-edd53c50-9729-48fa-aa53-51b9cb3941f1 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:44.518408 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-edd53c50-9729-48fa-aa53-51b9cb3941f1 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71289d2497de4089bfcdae8474859196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dc5f669f3f483bacc0bf258a11c302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:47:44.526684 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-edd53c50-9729-48fa-aa53-51b9cb3941f1 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] 10.222.0.25 "GET /compute/v2.1/servers/d3834ee5-6837-4b8d-abb2-0c048ef2d2e5" status: 200 len: 1319 microversion: 2.1 time: 0.215709 May 27 03:47:44.527253 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 453/957] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:47:44 2021] GET /compute/v2.1/servers/d3834ee5-6837-4b8d-abb2-0c048ef2d2e5 => generated 1319 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:47:44.564848 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-95e6cdb1-1373-484a-be4d-f3f1b75195f1 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:47:44.565409 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-95e6cdb1-1373-484a-be4d-f3f1b75195f1 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:47:44.573242 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-95e6cdb1-1373-484a-be4d-f3f1b75195f1 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:44.573701 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-95e6cdb1-1373-484a-be4d-f3f1b75195f1 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:44.574474 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-95e6cdb1-1373-484a-be4d-f3f1b75195f1 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:44.574917 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-95e6cdb1-1373-484a-be4d-f3f1b75195f1 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:44.768248 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-95e6cdb1-1373-484a-be4d-f3f1b75195f1 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:47:44.776485 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-95e6cdb1-1373-484a-be4d-f3f1b75195f1 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1677 microversion: 2.1 time: 0.215425 May 27 03:47:44.777048 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 505/958] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:47:44 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1677 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:47:45.545624 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-1297ab98-88de-4d38-a0bb-b1308cb9af82 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:47:45.546052 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-1297ab98-88de-4d38-a0bb-b1308cb9af82 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] [instance: d3834ee5-6837-4b8d-abb2-0c048ef2d2e5] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:47:45.553290 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1297ab98-88de-4d38-a0bb-b1308cb9af82 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:45.553741 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1297ab98-88de-4d38-a0bb-b1308cb9af82 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:45.554526 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1297ab98-88de-4d38-a0bb-b1308cb9af82 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:45.554959 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1297ab98-88de-4d38-a0bb-b1308cb9af82 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:45.747459 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-1297ab98-88de-4d38-a0bb-b1308cb9af82 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71289d2497de4089bfcdae8474859196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dc5f669f3f483bacc0bf258a11c302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:47:45.756211 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-1297ab98-88de-4d38-a0bb-b1308cb9af82 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] 10.222.0.25 "GET /compute/v2.1/servers/d3834ee5-6837-4b8d-abb2-0c048ef2d2e5" status: 200 len: 1319 microversion: 2.1 time: 0.216416 May 27 03:47:45.756815 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 454/959] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:47:45 2021] GET /compute/v2.1/servers/d3834ee5-6837-4b8d-abb2-0c048ef2d2e5 => generated 1319 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:47:45.793404 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-58f8f214-ecf3-48ad-8fcf-1607c973b438 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:47:45.794016 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-58f8f214-ecf3-48ad-8fcf-1607c973b438 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:47:45.801170 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-58f8f214-ecf3-48ad-8fcf-1607c973b438 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:45.802156 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-58f8f214-ecf3-48ad-8fcf-1607c973b438 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:45.802977 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-58f8f214-ecf3-48ad-8fcf-1607c973b438 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:45.803417 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-58f8f214-ecf3-48ad-8fcf-1607c973b438 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:46.001755 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-58f8f214-ecf3-48ad-8fcf-1607c973b438 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:47:46.010595 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-58f8f214-ecf3-48ad-8fcf-1607c973b438 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1677 microversion: 2.1 time: 0.220877 May 27 03:47:46.011164 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 506/960] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:47:45 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1677 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:47:46.773192 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-321d8dc4-454f-4739-b092-8f101648b945 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:47:46.773811 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-321d8dc4-454f-4739-b092-8f101648b945 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] [instance: d3834ee5-6837-4b8d-abb2-0c048ef2d2e5] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:47:46.781058 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-321d8dc4-454f-4739-b092-8f101648b945 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:46.781513 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-321d8dc4-454f-4739-b092-8f101648b945 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:46.782275 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-321d8dc4-454f-4739-b092-8f101648b945 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:46.782709 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-321d8dc4-454f-4739-b092-8f101648b945 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:47.027577 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-3087d00b-9935-4930-88b6-e1a3058ee99b tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:47:47.028107 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-3087d00b-9935-4930-88b6-e1a3058ee99b tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:47:47.035447 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3087d00b-9935-4930-88b6-e1a3058ee99b tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:47.036428 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3087d00b-9935-4930-88b6-e1a3058ee99b tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:47.037201 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3087d00b-9935-4930-88b6-e1a3058ee99b tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:47.037643 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3087d00b-9935-4930-88b6-e1a3058ee99b tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:47.053430 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-321d8dc4-454f-4739-b092-8f101648b945 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71289d2497de4089bfcdae8474859196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dc5f669f3f483bacc0bf258a11c302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:47:47.061664 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-321d8dc4-454f-4739-b092-8f101648b945 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] 10.222.0.25 "GET /compute/v2.1/servers/d3834ee5-6837-4b8d-abb2-0c048ef2d2e5" status: 200 len: 1319 microversion: 2.1 time: 0.292682 May 27 03:47:47.062308 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 455/961] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:47:46 2021] GET /compute/v2.1/servers/d3834ee5-6837-4b8d-abb2-0c048ef2d2e5 => generated 1319 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:47:47.231782 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-3087d00b-9935-4930-88b6-e1a3058ee99b tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:47:47.239985 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-3087d00b-9935-4930-88b6-e1a3058ee99b tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1677 microversion: 2.1 time: 0.216227 May 27 03:47:47.240580 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 507/962] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:47:47 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1677 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:47:47.799305 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 03:47:47.799527 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: Thu May 27 03:47:47 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 03:47:47.877756 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [req-51eb6ec6-e947-49e3-ac41-141ce1117b90 req-346abf52-fdf3-4de7-9943-8c8fada545d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3834ee5-6837-4b8d-abb2-0c048ef2d2e5", "name": "network-vif-plugged", "status": "completed", "tag": "d711e7b6-b731-4377-8814-b74e7863713f"}]} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:47:47.879365 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:47:47.879365 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: warnings.warn(msg) May 27 03:47:47.887353 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-51eb6ec6-e947-49e3-ac41-141ce1117b90 req-346abf52-fdf3-4de7-9943-8c8fada545d3 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:47.887802 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-51eb6ec6-e947-49e3-ac41-141ce1117b90 req-346abf52-fdf3-4de7-9943-8c8fada545d3 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:47.903042 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.compute.server_external_events [req-51eb6ec6-e947-49e3-ac41-141ce1117b90 req-346abf52-fdf3-4de7-9943-8c8fada545d3 service nova] Creating event network-vif-plugged:d711e7b6-b731-4377-8814-b74e7863713f for instance d3834ee5-6837-4b8d-abb2-0c048ef2d2e5 on hv-cinder-79326 May 27 03:47:47.907844 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [req-51eb6ec6-e947-49e3-ac41-141ce1117b90 req-346abf52-fdf3-4de7-9943-8c8fada545d3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033741 May 27 03:47:47.908428 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 456/963] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:47:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:47:48.078585 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-0b5f933f-7f13-494f-b891-7d75ee17f0c1 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:47:48.079137 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-0b5f933f-7f13-494f-b891-7d75ee17f0c1 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] [instance: d3834ee5-6837-4b8d-abb2-0c048ef2d2e5] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:47:48.086895 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0b5f933f-7f13-494f-b891-7d75ee17f0c1 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:48.087469 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0b5f933f-7f13-494f-b891-7d75ee17f0c1 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:48.088135 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0b5f933f-7f13-494f-b891-7d75ee17f0c1 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:48.088607 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0b5f933f-7f13-494f-b891-7d75ee17f0c1 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:48.256692 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-bfc9b3e3-6870-42c0-8081-cc3b47f12f85 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:47:48.257659 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-bfc9b3e3-6870-42c0-8081-cc3b47f12f85 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:47:48.265258 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-bfc9b3e3-6870-42c0-8081-cc3b47f12f85 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:48.265820 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-bfc9b3e3-6870-42c0-8081-cc3b47f12f85 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:48.266689 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-bfc9b3e3-6870-42c0-8081-cc3b47f12f85 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:48.267209 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-bfc9b3e3-6870-42c0-8081-cc3b47f12f85 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:48.288144 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-0b5f933f-7f13-494f-b891-7d75ee17f0c1 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71289d2497de4089bfcdae8474859196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dc5f669f3f483bacc0bf258a11c302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:47:48.296179 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-0b5f933f-7f13-494f-b891-7d75ee17f0c1 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] 10.222.0.25 "GET /compute/v2.1/servers/d3834ee5-6837-4b8d-abb2-0c048ef2d2e5" status: 200 len: 1319 microversion: 2.1 time: 0.221411 May 27 03:47:48.299251 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 508/964] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:47:48 2021] GET /compute/v2.1/servers/d3834ee5-6837-4b8d-abb2-0c048ef2d2e5 => generated 1319 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:47:48.465049 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-bfc9b3e3-6870-42c0-8081-cc3b47f12f85 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:47:48.473200 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-bfc9b3e3-6870-42c0-8081-cc3b47f12f85 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1677 microversion: 2.1 time: 0.220662 May 27 03:47:48.473838 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 457/965] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:47:48 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1677 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:47:49.312969 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-d2385edd-b99e-4db0-84ce-8c97dbf0d806 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:47:49.313587 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-d2385edd-b99e-4db0-84ce-8c97dbf0d806 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] [instance: d3834ee5-6837-4b8d-abb2-0c048ef2d2e5] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:47:49.320835 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d2385edd-b99e-4db0-84ce-8c97dbf0d806 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:49.321301 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d2385edd-b99e-4db0-84ce-8c97dbf0d806 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:49.322043 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d2385edd-b99e-4db0-84ce-8c97dbf0d806 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:49.322483 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d2385edd-b99e-4db0-84ce-8c97dbf0d806 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:49.490899 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-8fc24dcd-9d55-4f06-832e-984fbe1d9640 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:47:49.491558 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-8fc24dcd-9d55-4f06-832e-984fbe1d9640 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:47:49.498979 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8fc24dcd-9d55-4f06-832e-984fbe1d9640 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:49.499438 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8fc24dcd-9d55-4f06-832e-984fbe1d9640 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:49.500217 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8fc24dcd-9d55-4f06-832e-984fbe1d9640 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:49.500683 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8fc24dcd-9d55-4f06-832e-984fbe1d9640 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:49.521069 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-d2385edd-b99e-4db0-84ce-8c97dbf0d806 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71289d2497de4089bfcdae8474859196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dc5f669f3f483bacc0bf258a11c302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:47:49.529180 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-d2385edd-b99e-4db0-84ce-8c97dbf0d806 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] 10.222.0.25 "GET /compute/v2.1/servers/d3834ee5-6837-4b8d-abb2-0c048ef2d2e5" status: 200 len: 1319 microversion: 2.1 time: 0.219866 May 27 03:47:49.533579 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 509/966] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:47:49 2021] GET /compute/v2.1/servers/d3834ee5-6837-4b8d-abb2-0c048ef2d2e5 => generated 1319 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:47:49.701749 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-8fc24dcd-9d55-4f06-832e-984fbe1d9640 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:47:49.710744 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-8fc24dcd-9d55-4f06-832e-984fbe1d9640 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1677 microversion: 2.1 time: 0.224082 May 27 03:47:49.711311 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 458/967] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:47:49 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1677 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:47:50.546338 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-c074dc1a-c553-46f5-a3a4-d76d32520fa5 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:47:50.546956 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-c074dc1a-c553-46f5-a3a4-d76d32520fa5 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] [instance: d3834ee5-6837-4b8d-abb2-0c048ef2d2e5] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:47:50.554758 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c074dc1a-c553-46f5-a3a4-d76d32520fa5 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:50.555211 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c074dc1a-c553-46f5-a3a4-d76d32520fa5 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:50.555977 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c074dc1a-c553-46f5-a3a4-d76d32520fa5 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:50.556437 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c074dc1a-c553-46f5-a3a4-d76d32520fa5 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:50.728337 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-d20ff4b7-2e80-4179-a51e-35565fcf008d tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:47:50.744296 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-d20ff4b7-2e80-4179-a51e-35565fcf008d tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:47:50.744296 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d20ff4b7-2e80-4179-a51e-35565fcf008d tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:50.744296 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d20ff4b7-2e80-4179-a51e-35565fcf008d tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:50.744296 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d20ff4b7-2e80-4179-a51e-35565fcf008d tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:50.744808 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d20ff4b7-2e80-4179-a51e-35565fcf008d tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:50.837240 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-c074dc1a-c553-46f5-a3a4-d76d32520fa5 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71289d2497de4089bfcdae8474859196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dc5f669f3f483bacc0bf258a11c302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:47:50.845558 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-c074dc1a-c553-46f5-a3a4-d76d32520fa5 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] 10.222.0.25 "GET /compute/v2.1/servers/d3834ee5-6837-4b8d-abb2-0c048ef2d2e5" status: 200 len: 1507 microversion: 2.1 time: 0.302876 May 27 03:47:50.856859 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 510/968] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:47:50 2021] GET /compute/v2.1/servers/d3834ee5-6837-4b8d-abb2-0c048ef2d2e5 => generated 1507 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:47:50.861681 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-39f00eb7-f920-470c-bc54-6f1242c23edd tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "86860ddb-000d-4905-b8bd-0d7644b76517", "device": "/dev/sdb"}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:47:50.863307 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-39f00eb7-f920-470c-bc54-6f1242c23edd tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] [instance: d3834ee5-6837-4b8d-abb2-0c048ef2d2e5] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:47:50.871022 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-39f00eb7-f920-470c-bc54-6f1242c23edd tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:50.871471 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-39f00eb7-f920-470c-bc54-6f1242c23edd tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:50.872244 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-39f00eb7-f920-470c-bc54-6f1242c23edd tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:50.872708 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-39f00eb7-f920-470c-bc54-6f1242c23edd tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:50.935586 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-d20ff4b7-2e80-4179-a51e-35565fcf008d tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:47:50.944758 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-d20ff4b7-2e80-4179-a51e-35565fcf008d tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1677 microversion: 2.1 time: 0.220119 May 27 03:47:50.945944 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 459/969] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:47:50 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1677 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:47:51.674042 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-39f00eb7-f920-470c-bc54-6f1242c23edd tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] 10.222.0.25 "POST /compute/v2.1/servers/d3834ee5-6837-4b8d-abb2-0c048ef2d2e5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.815812 May 27 03:47:51.674653 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 511/970] 10.222.0.25 () {60 vars in 1323 bytes} [Thu May 27 03:47:50 2021] POST /compute/v2.1/servers/d3834ee5-6837-4b8d-abb2-0c048ef2d2e5/os-volume_attachments => generated 194 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:47:51.961740 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-9a4a3bc9-a0ac-481e-8738-fab664cb6e88 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:47:51.962512 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-9a4a3bc9-a0ac-481e-8738-fab664cb6e88 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:47:51.970562 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-9a4a3bc9-a0ac-481e-8738-fab664cb6e88 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:51.971013 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-9a4a3bc9-a0ac-481e-8738-fab664cb6e88 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:51.971784 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-9a4a3bc9-a0ac-481e-8738-fab664cb6e88 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:51.972222 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-9a4a3bc9-a0ac-481e-8738-fab664cb6e88 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:52.168589 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-9a4a3bc9-a0ac-481e-8738-fab664cb6e88 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:47:52.177454 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-9a4a3bc9-a0ac-481e-8738-fab664cb6e88 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1654 microversion: 2.1 time: 0.218693 May 27 03:47:52.178104 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 460/971] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:47:51 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1654 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:47:52.198241 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-132d2695-4b02-4ef4-a5b9-99c4d6d9cd11 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:47:52.208116 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-132d2695-4b02-4ef4-a5b9-99c4d6d9cd11 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:52.208603 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-132d2695-4b02-4ef4-a5b9-99c4d6d9cd11 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:52.266073 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-132d2695-4b02-4ef4-a5b9-99c4d6d9cd11 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Going to try to start instance {{(pid=113020) start /opt/stack/nova/nova/compute/api.py:2602}} May 27 03:47:52.438819 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-132d2695-4b02-4ef4-a5b9-99c4d6d9cd11 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action" status: 202 len: 0 microversion: 2.1 time: 0.244409 May 27 03:47:52.439567 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 512/972] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:47:52 2021] POST /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:47:52.448457 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-1d4cfe42-3ba2-4369-8b15-64d3fcbc6004 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:47:52.449118 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-1d4cfe42-3ba2-4369-8b15-64d3fcbc6004 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:47:52.456774 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1d4cfe42-3ba2-4369-8b15-64d3fcbc6004 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:52.460229 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1d4cfe42-3ba2-4369-8b15-64d3fcbc6004 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:52.460229 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1d4cfe42-3ba2-4369-8b15-64d3fcbc6004 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:52.460229 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1d4cfe42-3ba2-4369-8b15-64d3fcbc6004 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:52.698290 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-1d4cfe42-3ba2-4369-8b15-64d3fcbc6004 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:47:52.706582 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-1d4cfe42-3ba2-4369-8b15-64d3fcbc6004 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1663 microversion: 2.1 time: 0.262911 May 27 03:47:52.716950 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 461/973] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:47:52 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1663 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:47:53.725417 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-7aae7f6a-b8f7-4fb7-9daa-d553862e6a30 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:47:53.726156 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-7aae7f6a-b8f7-4fb7-9daa-d553862e6a30 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:47:53.733588 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7aae7f6a-b8f7-4fb7-9daa-d553862e6a30 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:53.734042 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7aae7f6a-b8f7-4fb7-9daa-d553862e6a30 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:53.734809 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7aae7f6a-b8f7-4fb7-9daa-d553862e6a30 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:53.735246 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7aae7f6a-b8f7-4fb7-9daa-d553862e6a30 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:53.934263 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-7aae7f6a-b8f7-4fb7-9daa-d553862e6a30 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:47:53.942859 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-7aae7f6a-b8f7-4fb7-9daa-d553862e6a30 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1663 microversion: 2.1 time: 0.221765 May 27 03:47:53.943537 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 513/974] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:47:53 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1663 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:47:54.960303 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-057bea97-031f-4ad6-a6ff-e3b974d19501 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:47:54.960955 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-057bea97-031f-4ad6-a6ff-e3b974d19501 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:47:54.968275 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-057bea97-031f-4ad6-a6ff-e3b974d19501 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:54.968767 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-057bea97-031f-4ad6-a6ff-e3b974d19501 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:54.969550 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-057bea97-031f-4ad6-a6ff-e3b974d19501 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:54.969998 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-057bea97-031f-4ad6-a6ff-e3b974d19501 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:55.161332 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-057bea97-031f-4ad6-a6ff-e3b974d19501 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:47:55.169505 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-057bea97-031f-4ad6-a6ff-e3b974d19501 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1667 microversion: 2.1 time: 0.212929 May 27 03:47:55.170074 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 462/975] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:47:54 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1667 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:47:57.796091 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-78c13f40-e7f4-4687-942e-853ae6461a92 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:47:57.799855 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-78c13f40-e7f4-4687-942e-853ae6461a92 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] [instance: daffe717-7636-45e8-813d-8b2a6075c61e] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:47:57.805382 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-78c13f40-e7f4-4687-942e-853ae6461a92 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:57.805841 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-78c13f40-e7f4-4687-942e-853ae6461a92 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:57.806621 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-78c13f40-e7f4-4687-942e-853ae6461a92 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:57.807067 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-78c13f40-e7f4-4687-942e-853ae6461a92 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:58.045251 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-78c13f40-e7f4-4687-942e-853ae6461a92 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] 10.222.0.25 "POST /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e/action" status: 202 len: 0 microversion: 2.1 time: 0.252700 May 27 03:47:58.046528 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 514/976] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:47:57 2021] POST /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e/action => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:47:58.054517 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-c66af317-f717-44d8-b4c9-3959436c22ed tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:47:58.055130 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-c66af317-f717-44d8-b4c9-3959436c22ed tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] [instance: daffe717-7636-45e8-813d-8b2a6075c61e] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:47:58.062421 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c66af317-f717-44d8-b4c9-3959436c22ed tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:58.062874 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c66af317-f717-44d8-b4c9-3959436c22ed tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:58.063641 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c66af317-f717-44d8-b4c9-3959436c22ed tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:58.064073 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c66af317-f717-44d8-b4c9-3959436c22ed tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:58.481547 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-c66af317-f717-44d8-b4c9-3959436c22ed tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf67cc7398a4e1cb6f565ebe2241e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df96baa86bb4c51b3b8bece28e3e23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:47:58.490686 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-c66af317-f717-44d8-b4c9-3959436c22ed tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] 10.222.0.25 "GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e" status: 200 len: 1749 microversion: 2.1 time: 0.440517 May 27 03:47:58.491259 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 463/977] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:47:58 2021] GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e => generated 1749 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:47:59.509161 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-08937213-d67b-4d44-a64d-511db8df691f tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:47:59.509876 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-08937213-d67b-4d44-a64d-511db8df691f tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] [instance: daffe717-7636-45e8-813d-8b2a6075c61e] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:47:59.520172 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-08937213-d67b-4d44-a64d-511db8df691f tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:59.520172 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-08937213-d67b-4d44-a64d-511db8df691f tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:59.520172 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-08937213-d67b-4d44-a64d-511db8df691f tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:47:59.520172 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-08937213-d67b-4d44-a64d-511db8df691f tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:47:59.720715 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-08937213-d67b-4d44-a64d-511db8df691f tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf67cc7398a4e1cb6f565ebe2241e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df96baa86bb4c51b3b8bece28e3e23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:47:59.730125 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-08937213-d67b-4d44-a64d-511db8df691f tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] 10.222.0.25 "GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e" status: 200 len: 1754 microversion: 2.1 time: 0.226060 May 27 03:47:59.730775 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 515/978] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:47:59 2021] GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e => generated 1754 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:48:00.749337 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-525d3fe3-81cd-4210-bf03-9169d5aee960 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:48:00.749951 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-525d3fe3-81cd-4210-bf03-9169d5aee960 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] [instance: daffe717-7636-45e8-813d-8b2a6075c61e] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:48:00.757964 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-525d3fe3-81cd-4210-bf03-9169d5aee960 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:00.758426 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-525d3fe3-81cd-4210-bf03-9169d5aee960 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:00.759235 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-525d3fe3-81cd-4210-bf03-9169d5aee960 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:00.759699 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-525d3fe3-81cd-4210-bf03-9169d5aee960 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:00.969480 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-525d3fe3-81cd-4210-bf03-9169d5aee960 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf67cc7398a4e1cb6f565ebe2241e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df96baa86bb4c51b3b8bece28e3e23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:00.973492 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-525d3fe3-81cd-4210-bf03-9169d5aee960 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] 10.222.0.25 "GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e" status: 200 len: 1754 microversion: 2.1 time: 0.227790 May 27 03:48:00.974062 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 464/979] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:48:00 2021] GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e => generated 1754 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:48:01.990120 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-51a5c4ac-c310-4715-a401-030926b078e8 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:48:01.990738 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-51a5c4ac-c310-4715-a401-030926b078e8 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] [instance: daffe717-7636-45e8-813d-8b2a6075c61e] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:48:01.998641 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-51a5c4ac-c310-4715-a401-030926b078e8 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:01.999096 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-51a5c4ac-c310-4715-a401-030926b078e8 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:01.999873 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-51a5c4ac-c310-4715-a401-030926b078e8 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:02.000317 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-51a5c4ac-c310-4715-a401-030926b078e8 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:02.195899 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-51a5c4ac-c310-4715-a401-030926b078e8 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf67cc7398a4e1cb6f565ebe2241e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df96baa86bb4c51b3b8bece28e3e23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:02.204501 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-51a5c4ac-c310-4715-a401-030926b078e8 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] 10.222.0.25 "GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e" status: 200 len: 1754 microversion: 2.1 time: 0.218051 May 27 03:48:02.205087 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 516/980] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:48:01 2021] GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e => generated 1754 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:48:03.221730 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-9b0c8822-ff9b-4b94-a3dd-5967d825e29e tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:48:03.222312 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-9b0c8822-ff9b-4b94-a3dd-5967d825e29e tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] [instance: daffe717-7636-45e8-813d-8b2a6075c61e] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:48:03.230253 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-9b0c8822-ff9b-4b94-a3dd-5967d825e29e tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:03.230711 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-9b0c8822-ff9b-4b94-a3dd-5967d825e29e tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:03.231486 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-9b0c8822-ff9b-4b94-a3dd-5967d825e29e tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:03.231927 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-9b0c8822-ff9b-4b94-a3dd-5967d825e29e tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:03.433054 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-9b0c8822-ff9b-4b94-a3dd-5967d825e29e tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf67cc7398a4e1cb6f565ebe2241e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df96baa86bb4c51b3b8bece28e3e23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:03.442356 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-9b0c8822-ff9b-4b94-a3dd-5967d825e29e tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] 10.222.0.25 "GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e" status: 200 len: 1754 microversion: 2.1 time: 0.223834 May 27 03:48:03.447741 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 465/981] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:48:03 2021] GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e => generated 1754 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:48:04.459083 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-1899e87f-d4a0-4aa5-a501-8f534cd96148 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:48:04.459611 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-1899e87f-d4a0-4aa5-a501-8f534cd96148 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] [instance: daffe717-7636-45e8-813d-8b2a6075c61e] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:48:04.466951 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1899e87f-d4a0-4aa5-a501-8f534cd96148 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:04.467448 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1899e87f-d4a0-4aa5-a501-8f534cd96148 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:04.468208 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1899e87f-d4a0-4aa5-a501-8f534cd96148 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:04.468673 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1899e87f-d4a0-4aa5-a501-8f534cd96148 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:04.666820 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-1899e87f-d4a0-4aa5-a501-8f534cd96148 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf67cc7398a4e1cb6f565ebe2241e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df96baa86bb4c51b3b8bece28e3e23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:04.675347 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-1899e87f-d4a0-4aa5-a501-8f534cd96148 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] 10.222.0.25 "GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e" status: 200 len: 1754 microversion: 2.1 time: 0.220062 May 27 03:48:04.675902 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 517/982] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:48:04 2021] GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e => generated 1754 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:48:05.691837 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-56ae3182-07f9-4f9b-8578-1c74d4efef08 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:48:05.692515 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-56ae3182-07f9-4f9b-8578-1c74d4efef08 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] [instance: daffe717-7636-45e8-813d-8b2a6075c61e] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:48:05.699809 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-56ae3182-07f9-4f9b-8578-1c74d4efef08 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:05.700268 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-56ae3182-07f9-4f9b-8578-1c74d4efef08 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:05.701077 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-56ae3182-07f9-4f9b-8578-1c74d4efef08 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:05.701519 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-56ae3182-07f9-4f9b-8578-1c74d4efef08 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:05.898856 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-56ae3182-07f9-4f9b-8578-1c74d4efef08 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf67cc7398a4e1cb6f565ebe2241e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df96baa86bb4c51b3b8bece28e3e23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:05.907404 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-56ae3182-07f9-4f9b-8578-1c74d4efef08 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] 10.222.0.25 "GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e" status: 200 len: 1754 microversion: 2.1 time: 0.219236 May 27 03:48:05.907970 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 466/983] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:48:05 2021] GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e => generated 1754 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:48:06.924111 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-9b34808b-f4b0-4920-8cdd-b647b5548be6 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:48:06.924759 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-9b34808b-f4b0-4920-8cdd-b647b5548be6 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] [instance: daffe717-7636-45e8-813d-8b2a6075c61e] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:48:06.932147 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9b34808b-f4b0-4920-8cdd-b647b5548be6 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:06.932752 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9b34808b-f4b0-4920-8cdd-b647b5548be6 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:06.933523 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9b34808b-f4b0-4920-8cdd-b647b5548be6 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:06.933956 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9b34808b-f4b0-4920-8cdd-b647b5548be6 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:07.129057 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-9b34808b-f4b0-4920-8cdd-b647b5548be6 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf67cc7398a4e1cb6f565ebe2241e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df96baa86bb4c51b3b8bece28e3e23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:07.137618 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-9b34808b-f4b0-4920-8cdd-b647b5548be6 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] 10.222.0.25 "GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e" status: 200 len: 1754 microversion: 2.1 time: 0.217133 May 27 03:48:07.138173 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 518/984] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:48:06 2021] GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e => generated 1754 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:48:08.154443 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-ebce437a-cf92-4ee3-80e7-4172fae889fd tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:48:08.155058 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-ebce437a-cf92-4ee3-80e7-4172fae889fd tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] [instance: daffe717-7636-45e8-813d-8b2a6075c61e] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:48:08.163092 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ebce437a-cf92-4ee3-80e7-4172fae889fd tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:08.163541 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ebce437a-cf92-4ee3-80e7-4172fae889fd tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:08.164301 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ebce437a-cf92-4ee3-80e7-4172fae889fd tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:08.164765 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ebce437a-cf92-4ee3-80e7-4172fae889fd tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:08.362656 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-ebce437a-cf92-4ee3-80e7-4172fae889fd tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf67cc7398a4e1cb6f565ebe2241e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df96baa86bb4c51b3b8bece28e3e23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:08.371447 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-ebce437a-cf92-4ee3-80e7-4172fae889fd tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] 10.222.0.25 "GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e" status: 200 len: 1754 microversion: 2.1 time: 0.220635 May 27 03:48:08.376726 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 467/985] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:48:08 2021] GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e => generated 1754 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:48:09.391484 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-aa9c2fe9-68cf-4339-9f22-1ad4d54d0a9e tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:48:09.392101 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-aa9c2fe9-68cf-4339-9f22-1ad4d54d0a9e tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] [instance: daffe717-7636-45e8-813d-8b2a6075c61e] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:48:09.399549 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-aa9c2fe9-68cf-4339-9f22-1ad4d54d0a9e tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:09.400001 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-aa9c2fe9-68cf-4339-9f22-1ad4d54d0a9e tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:09.400797 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-aa9c2fe9-68cf-4339-9f22-1ad4d54d0a9e tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:09.401239 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-aa9c2fe9-68cf-4339-9f22-1ad4d54d0a9e tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:09.439954 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-4e921de5-8f2b-4bbc-abf8-00548c929b29 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:48:09.440511 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-4e921de5-8f2b-4bbc-abf8-00548c929b29 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:48:09.447899 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-4e921de5-8f2b-4bbc-abf8-00548c929b29 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:09.448290 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-4e921de5-8f2b-4bbc-abf8-00548c929b29 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:09.449117 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-4e921de5-8f2b-4bbc-abf8-00548c929b29 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:09.449553 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-4e921de5-8f2b-4bbc-abf8-00548c929b29 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:09.517501 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-4e921de5-8f2b-4bbc-abf8-00548c929b29 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/os-volume_attachments/1e8bb561-2451-42cb-95e9-3bbd0879295b" status: 200 len: 194 microversion: 2.20 time: 0.081366 May 27 03:48:09.518262 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 468/986] 10.222.0.25 () {60 vars in 1454 bytes} [Thu May 27 03:48:09 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/os-volume_attachments/1e8bb561-2451-42cb-95e9-3bbd0879295b => generated 194 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 03:48:09.602473 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-aa9c2fe9-68cf-4339-9f22-1ad4d54d0a9e tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf67cc7398a4e1cb6f565ebe2241e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df96baa86bb4c51b3b8bece28e3e23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:09.611277 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-aa9c2fe9-68cf-4339-9f22-1ad4d54d0a9e tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] 10.222.0.25 "GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e" status: 200 len: 1754 microversion: 2.1 time: 0.223431 May 27 03:48:09.611832 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 519/987] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:48:09 2021] GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e => generated 1754 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:48:09.627135 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-6ce782fb-bb8a-4664-a8c5-f7eaefbd63ea tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:48:09.627642 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-6ce782fb-bb8a-4664-a8c5-f7eaefbd63ea tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:48:09.634939 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6ce782fb-bb8a-4664-a8c5-f7eaefbd63ea tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:09.635397 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6ce782fb-bb8a-4664-a8c5-f7eaefbd63ea tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:09.636166 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6ce782fb-bb8a-4664-a8c5-f7eaefbd63ea tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:09.636657 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6ce782fb-bb8a-4664-a8c5-f7eaefbd63ea tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:09.794282 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.objects.instance [None req-6ce782fb-bb8a-4664-a8c5-f7eaefbd63ea tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lazy-loading 'services' on Instance uuid e367eb4b-29c5-4f41-b41d-0da84d751fe2 {{(pid=113021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 27 03:48:10.109493 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-6ce782fb-bb8a-4664-a8c5-f7eaefbd63ea tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/os-volume_attachments/1e8bb561-2451-42cb-95e9-3bbd0879295b" status: 202 len: 0 microversion: 2.20 time: 0.485856 May 27 03:48:10.110086 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 469/988] 10.222.0.25 () {60 vars in 1457 bytes} [Thu May 27 03:48:09 2021] DELETE /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2/os-volume_attachments/1e8bb561-2451-42cb-95e9-3bbd0879295b => generated 0 bytes in 487 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 27 03:48:10.628993 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-4df8ed3f-3b45-4a2a-8f6e-c0f07b14fe3f tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:48:10.629618 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-4df8ed3f-3b45-4a2a-8f6e-c0f07b14fe3f tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] [instance: daffe717-7636-45e8-813d-8b2a6075c61e] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:48:10.637967 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4df8ed3f-3b45-4a2a-8f6e-c0f07b14fe3f tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:10.638424 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4df8ed3f-3b45-4a2a-8f6e-c0f07b14fe3f tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:10.639198 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4df8ed3f-3b45-4a2a-8f6e-c0f07b14fe3f tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:10.639638 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4df8ed3f-3b45-4a2a-8f6e-c0f07b14fe3f tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:10.836811 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-4df8ed3f-3b45-4a2a-8f6e-c0f07b14fe3f tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf67cc7398a4e1cb6f565ebe2241e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df96baa86bb4c51b3b8bece28e3e23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:10.845430 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-4df8ed3f-3b45-4a2a-8f6e-c0f07b14fe3f tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] 10.222.0.25 "GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e" status: 200 len: 1754 microversion: 2.1 time: 0.220131 May 27 03:48:10.845980 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 520/989] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:48:10 2021] GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e => generated 1754 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:48:11.862761 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-78abaf1f-3d6f-4d09-8265-d1ba35959a77 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:48:11.863464 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-78abaf1f-3d6f-4d09-8265-d1ba35959a77 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] [instance: daffe717-7636-45e8-813d-8b2a6075c61e] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:48:11.870950 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-78abaf1f-3d6f-4d09-8265-d1ba35959a77 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:11.871409 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-78abaf1f-3d6f-4d09-8265-d1ba35959a77 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:11.872178 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-78abaf1f-3d6f-4d09-8265-d1ba35959a77 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:11.872655 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-78abaf1f-3d6f-4d09-8265-d1ba35959a77 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:12.070768 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-78abaf1f-3d6f-4d09-8265-d1ba35959a77 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf67cc7398a4e1cb6f565ebe2241e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df96baa86bb4c51b3b8bece28e3e23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:12.079421 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-78abaf1f-3d6f-4d09-8265-d1ba35959a77 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] 10.222.0.25 "GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e" status: 200 len: 1754 microversion: 2.1 time: 0.220862 May 27 03:48:12.079983 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 470/990] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:48:11 2021] GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e => generated 1754 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:48:13.096059 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-921ae5dd-6aa2-4a78-b27e-55469f317564 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:48:13.096636 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-921ae5dd-6aa2-4a78-b27e-55469f317564 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] [instance: daffe717-7636-45e8-813d-8b2a6075c61e] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:48:13.104512 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-921ae5dd-6aa2-4a78-b27e-55469f317564 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:13.104966 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-921ae5dd-6aa2-4a78-b27e-55469f317564 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:13.105736 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-921ae5dd-6aa2-4a78-b27e-55469f317564 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:13.106173 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-921ae5dd-6aa2-4a78-b27e-55469f317564 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:13.300988 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-921ae5dd-6aa2-4a78-b27e-55469f317564 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf67cc7398a4e1cb6f565ebe2241e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df96baa86bb4c51b3b8bece28e3e23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:13.309547 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-921ae5dd-6aa2-4a78-b27e-55469f317564 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] 10.222.0.25 "GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e" status: 200 len: 1754 microversion: 2.1 time: 0.217198 May 27 03:48:13.310110 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 521/991] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:48:13 2021] GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e => generated 1754 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:48:14.326654 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-61066f8d-6fc4-4e86-98ad-703c8ffeda80 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:48:14.327277 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-61066f8d-6fc4-4e86-98ad-703c8ffeda80 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] [instance: daffe717-7636-45e8-813d-8b2a6075c61e] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:48:14.335001 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-61066f8d-6fc4-4e86-98ad-703c8ffeda80 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:14.335455 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-61066f8d-6fc4-4e86-98ad-703c8ffeda80 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:14.336217 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-61066f8d-6fc4-4e86-98ad-703c8ffeda80 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:14.336686 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-61066f8d-6fc4-4e86-98ad-703c8ffeda80 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:14.534534 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-61066f8d-6fc4-4e86-98ad-703c8ffeda80 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf67cc7398a4e1cb6f565ebe2241e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df96baa86bb4c51b3b8bece28e3e23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:14.543838 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-61066f8d-6fc4-4e86-98ad-703c8ffeda80 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] 10.222.0.25 "GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e" status: 200 len: 1754 microversion: 2.1 time: 0.220779 May 27 03:48:14.544419 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 471/992] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:48:14 2021] GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e => generated 1754 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:48:15.560794 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-e2ca9908-8a5f-491c-a4c0-f4b91849716d tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:48:15.561426 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-e2ca9908-8a5f-491c-a4c0-f4b91849716d tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] [instance: daffe717-7636-45e8-813d-8b2a6075c61e] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:48:15.568770 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e2ca9908-8a5f-491c-a4c0-f4b91849716d tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:15.569238 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e2ca9908-8a5f-491c-a4c0-f4b91849716d tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:15.570018 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e2ca9908-8a5f-491c-a4c0-f4b91849716d tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:15.570465 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e2ca9908-8a5f-491c-a4c0-f4b91849716d tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:15.676646 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-19f09ce3-3d2a-4edd-9143-9121829c1cd6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:48:15.677154 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-19f09ce3-3d2a-4edd-9143-9121829c1cd6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:48:15.685036 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-19f09ce3-3d2a-4edd-9143-9121829c1cd6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:15.685496 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-19f09ce3-3d2a-4edd-9143-9121829c1cd6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:15.686331 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-19f09ce3-3d2a-4edd-9143-9121829c1cd6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:15.686780 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-19f09ce3-3d2a-4edd-9143-9121829c1cd6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:15.749943 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-19f09ce3-3d2a-4edd-9143-9121829c1cd6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Going to try to terminate instance {{(pid=113021) delete /opt/stack/nova/nova/compute/api.py:2539}} May 27 03:48:15.770016 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-e2ca9908-8a5f-491c-a4c0-f4b91849716d tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf67cc7398a4e1cb6f565ebe2241e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df96baa86bb4c51b3b8bece28e3e23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:15.779674 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-e2ca9908-8a5f-491c-a4c0-f4b91849716d tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] 10.222.0.25 "GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e" status: 200 len: 1754 microversion: 2.1 time: 0.222586 May 27 03:48:15.784338 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 522/993] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:48:15 2021] GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e => generated 1754 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:48:16.053195 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-19f09ce3-3d2a-4edd-9143-9121829c1cd6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 204 len: 0 microversion: 2.20 time: 0.379791 May 27 03:48:16.054091 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 472/994] 10.222.0.25 () {60 vars in 1280 bytes} [Thu May 27 03:48:15 2021] DELETE /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 27 03:48:16.068307 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-70b28da5-c4dc-4e4b-a712-9c925f644b8a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:48:16.068963 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-70b28da5-c4dc-4e4b-a712-9c925f644b8a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:48:16.077705 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-70b28da5-c4dc-4e4b-a712-9c925f644b8a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:16.077705 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-70b28da5-c4dc-4e4b-a712-9c925f644b8a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:16.078372 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-70b28da5-c4dc-4e4b-a712-9c925f644b8a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:16.078820 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-70b28da5-c4dc-4e4b-a712-9c925f644b8a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:16.300963 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-70b28da5-c4dc-4e4b-a712-9c925f644b8a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:16.310741 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-70b28da5-c4dc-4e4b-a712-9c925f644b8a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:16.312588 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-70b28da5-c4dc-4e4b-a712-9c925f644b8a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:16.313957 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-70b28da5-c4dc-4e4b-a712-9c925f644b8a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1723 microversion: 2.20 time: 0.249810 May 27 03:48:16.314679 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 523/995] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:48:16 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1723 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:48:16.798087 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-d5b78114-f97c-4faf-af12-378980fc3a49 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:48:16.798784 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-d5b78114-f97c-4faf-af12-378980fc3a49 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] [instance: daffe717-7636-45e8-813d-8b2a6075c61e] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:48:16.806570 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d5b78114-f97c-4faf-af12-378980fc3a49 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:16.807022 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d5b78114-f97c-4faf-af12-378980fc3a49 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:16.807785 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d5b78114-f97c-4faf-af12-378980fc3a49 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:16.808221 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d5b78114-f97c-4faf-af12-378980fc3a49 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:17.012275 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-d5b78114-f97c-4faf-af12-378980fc3a49 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf67cc7398a4e1cb6f565ebe2241e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df96baa86bb4c51b3b8bece28e3e23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:17.021903 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-d5b78114-f97c-4faf-af12-378980fc3a49 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] 10.222.0.25 "GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e" status: 200 len: 1754 microversion: 2.1 time: 0.227241 May 27 03:48:17.022478 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 473/996] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:48:16 2021] GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e => generated 1754 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:48:17.335808 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-ba99312e-ada8-4f3c-83c6-aef38c8176d3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:48:17.336473 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-ba99312e-ada8-4f3c-83c6-aef38c8176d3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:48:17.344511 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ba99312e-ada8-4f3c-83c6-aef38c8176d3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:17.344511 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ba99312e-ada8-4f3c-83c6-aef38c8176d3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:17.345123 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ba99312e-ada8-4f3c-83c6-aef38c8176d3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:17.345555 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ba99312e-ada8-4f3c-83c6-aef38c8176d3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:17.541095 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-ba99312e-ada8-4f3c-83c6-aef38c8176d3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:17.549856 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-ba99312e-ada8-4f3c-83c6-aef38c8176d3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:17.551367 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-ba99312e-ada8-4f3c-83c6-aef38c8176d3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:17.553011 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-ba99312e-ada8-4f3c-83c6-aef38c8176d3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1723 microversion: 2.20 time: 0.220317 May 27 03:48:17.553569 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 524/997] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:48:17 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1723 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:48:18.039557 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-481b6f20-ea94-444b-80f0-d33dfb706eff tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:48:18.040116 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-481b6f20-ea94-444b-80f0-d33dfb706eff tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] [instance: daffe717-7636-45e8-813d-8b2a6075c61e] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:48:18.047265 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-481b6f20-ea94-444b-80f0-d33dfb706eff tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:18.047717 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-481b6f20-ea94-444b-80f0-d33dfb706eff tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:18.048506 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-481b6f20-ea94-444b-80f0-d33dfb706eff tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:18.048942 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-481b6f20-ea94-444b-80f0-d33dfb706eff tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:18.251037 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-481b6f20-ea94-444b-80f0-d33dfb706eff tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf67cc7398a4e1cb6f565ebe2241e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df96baa86bb4c51b3b8bece28e3e23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:18.259690 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-481b6f20-ea94-444b-80f0-d33dfb706eff tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] 10.222.0.25 "GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e" status: 200 len: 1754 microversion: 2.1 time: 0.224507 May 27 03:48:18.260472 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 474/998] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:48:18 2021] GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e => generated 1754 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:48:18.571600 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-31bf381e-8782-4200-bf2b-83e0a434ff75 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:48:18.572227 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-31bf381e-8782-4200-bf2b-83e0a434ff75 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:48:18.579670 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-31bf381e-8782-4200-bf2b-83e0a434ff75 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:18.579984 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-31bf381e-8782-4200-bf2b-83e0a434ff75 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:18.580940 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-31bf381e-8782-4200-bf2b-83e0a434ff75 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:18.581391 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-31bf381e-8782-4200-bf2b-83e0a434ff75 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:18.601513 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-2c27034c-0a5b-46ec-88ac-e2eacace05dc tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:48:18.602239 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-2c27034c-0a5b-46ec-88ac-e2eacace05dc tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] [instance: d3834ee5-6837-4b8d-abb2-0c048ef2d2e5] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:48:18.609311 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2c27034c-0a5b-46ec-88ac-e2eacace05dc tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:18.609777 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2c27034c-0a5b-46ec-88ac-e2eacace05dc tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:18.610524 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2c27034c-0a5b-46ec-88ac-e2eacace05dc tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:18.611182 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2c27034c-0a5b-46ec-88ac-e2eacace05dc tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:18.778936 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.objects.instance [None req-2c27034c-0a5b-46ec-88ac-e2eacace05dc tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lazy-loading 'services' on Instance uuid d3834ee5-6837-4b8d-abb2-0c048ef2d2e5 {{(pid=113021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 27 03:48:18.797560 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-31bf381e-8782-4200-bf2b-83e0a434ff75 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:18.806877 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-31bf381e-8782-4200-bf2b-83e0a434ff75 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:18.808393 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-31bf381e-8782-4200-bf2b-83e0a434ff75 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:18.809538 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-31bf381e-8782-4200-bf2b-83e0a434ff75 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1723 microversion: 2.20 time: 0.242595 May 27 03:48:18.810082 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 525/999] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:48:18 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1723 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:48:19.063436 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-2c27034c-0a5b-46ec-88ac-e2eacace05dc tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d3834ee5-6837-4b8d-abb2-0c048ef2d2e5/os-volume_attachments/86860ddb-000d-4905-b8bd-0d7644b76517" status: 202 len: 0 microversion: 2.1 time: 0.465558 May 27 03:48:19.064255 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 475/1000] 10.222.0.25 () {58 vars in 1416 bytes} [Thu May 27 03:48:18 2021] DELETE /compute/v2.1/servers/d3834ee5-6837-4b8d-abb2-0c048ef2d2e5/os-volume_attachments/86860ddb-000d-4905-b8bd-0d7644b76517 => generated 0 bytes in 467 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 27 03:48:19.277594 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-9f64c86f-931a-429d-ba3d-b63825dce433 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:48:19.278298 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-9f64c86f-931a-429d-ba3d-b63825dce433 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] [instance: daffe717-7636-45e8-813d-8b2a6075c61e] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:48:19.286576 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9f64c86f-931a-429d-ba3d-b63825dce433 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:19.287112 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9f64c86f-931a-429d-ba3d-b63825dce433 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:19.287993 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9f64c86f-931a-429d-ba3d-b63825dce433 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:19.288553 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9f64c86f-931a-429d-ba3d-b63825dce433 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:19.493982 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-9f64c86f-931a-429d-ba3d-b63825dce433 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf67cc7398a4e1cb6f565ebe2241e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df96baa86bb4c51b3b8bece28e3e23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:19.503019 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-9f64c86f-931a-429d-ba3d-b63825dce433 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] 10.222.0.25 "GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e" status: 200 len: 1754 microversion: 2.1 time: 0.229595 May 27 03:48:19.503582 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 526/1001] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:48:19 2021] GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e => generated 1754 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:48:19.829555 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-ec129ba5-0887-424f-9637-1db5aa2ab480 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:48:19.830296 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-ec129ba5-0887-424f-9637-1db5aa2ab480 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:48:19.837996 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ec129ba5-0887-424f-9637-1db5aa2ab480 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:19.838449 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ec129ba5-0887-424f-9637-1db5aa2ab480 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:19.839230 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ec129ba5-0887-424f-9637-1db5aa2ab480 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:19.839671 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ec129ba5-0887-424f-9637-1db5aa2ab480 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:20.007852 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-ec129ba5-0887-424f-9637-1db5aa2ab480 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:20.018097 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-ec129ba5-0887-424f-9637-1db5aa2ab480 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:20.020340 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-ec129ba5-0887-424f-9637-1db5aa2ab480 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:20.022539 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-ec129ba5-0887-424f-9637-1db5aa2ab480 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1656 microversion: 2.20 time: 0.198995 May 27 03:48:20.033204 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 476/1002] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:48:19 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1656 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:48:20.040016 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [req-57ca3f46-f699-4533-a43d-141ed4f3ffe0 req-698ae6e2-9360-4238-b6d1-2f5b3e1c2756 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e367eb4b-29c5-4f41-b41d-0da84d751fe2", "name": "network-vif-deleted", "tag": "396ee32c-72a8-43ea-b35c-f0de6de19d7a"}]} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:48:20.041723 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:48:20.041723 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: warnings.warn(msg) May 27 03:48:20.051259 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-57ca3f46-f699-4533-a43d-141ed4f3ffe0 req-698ae6e2-9360-4238-b6d1-2f5b3e1c2756 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:20.051708 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-57ca3f46-f699-4533-a43d-141ed4f3ffe0 req-698ae6e2-9360-4238-b6d1-2f5b3e1c2756 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:20.068516 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.compute.server_external_events [req-57ca3f46-f699-4533-a43d-141ed4f3ffe0 req-698ae6e2-9360-4238-b6d1-2f5b3e1c2756 service nova] Creating event network-vif-deleted:396ee32c-72a8-43ea-b35c-f0de6de19d7a for instance e367eb4b-29c5-4f41-b41d-0da84d751fe2 on hv-cinder-79326 May 27 03:48:20.073610 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [req-57ca3f46-f699-4533-a43d-141ed4f3ffe0 req-698ae6e2-9360-4238-b6d1-2f5b3e1c2756 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037284 May 27 03:48:20.074203 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 527/1003] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:48:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:48:20.521266 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-0d1eef9f-863e-407b-a8ce-09b1d670c3f3 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:48:20.521892 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-0d1eef9f-863e-407b-a8ce-09b1d670c3f3 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] [instance: daffe717-7636-45e8-813d-8b2a6075c61e] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:48:20.531076 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-0d1eef9f-863e-407b-a8ce-09b1d670c3f3 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:20.532039 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-0d1eef9f-863e-407b-a8ce-09b1d670c3f3 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:20.532870 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-0d1eef9f-863e-407b-a8ce-09b1d670c3f3 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:20.533319 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-0d1eef9f-863e-407b-a8ce-09b1d670c3f3 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:20.731129 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-0d1eef9f-863e-407b-a8ce-09b1d670c3f3 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf67cc7398a4e1cb6f565ebe2241e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df96baa86bb4c51b3b8bece28e3e23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:20.740366 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-0d1eef9f-863e-407b-a8ce-09b1d670c3f3 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] 10.222.0.25 "GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e" status: 200 len: 1754 microversion: 2.1 time: 0.223336 May 27 03:48:20.740957 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 477/1004] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:48:20 2021] GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e => generated 1754 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:48:21.043057 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-629f14b6-9947-4571-b3e6-0d5bca23d50f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:48:21.044365 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-629f14b6-9947-4571-b3e6-0d5bca23d50f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:48:21.055819 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-629f14b6-9947-4571-b3e6-0d5bca23d50f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:21.056444 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-629f14b6-9947-4571-b3e6-0d5bca23d50f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:21.058819 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-629f14b6-9947-4571-b3e6-0d5bca23d50f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:21.058819 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-629f14b6-9947-4571-b3e6-0d5bca23d50f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:21.131901 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-629f14b6-9947-4571-b3e6-0d5bca23d50f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:21.132354 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-629f14b6-9947-4571-b3e6-0d5bca23d50f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:21.132880 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.objects.instance [None req-629f14b6-9947-4571-b3e6-0d5bca23d50f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lazy-loading 'fault' on Instance uuid e367eb4b-29c5-4f41-b41d-0da84d751fe2 {{(pid=113020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 27 03:48:21.191800 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-629f14b6-9947-4571-b3e6-0d5bca23d50f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:21.201610 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-629f14b6-9947-4571-b3e6-0d5bca23d50f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:21.203484 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-629f14b6-9947-4571-b3e6-0d5bca23d50f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:21.204865 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-629f14b6-9947-4571-b3e6-0d5bca23d50f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 200 len: 1371 microversion: 2.20 time: 0.166814 May 27 03:48:21.205687 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 528/1005] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:48:21 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 1371 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:48:21.498541 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-90c50898-d435-4fea-b230-c5557ce70079 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:48:21.499044 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-90c50898-d435-4fea-b230-c5557ce70079 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] [instance: d3834ee5-6837-4b8d-abb2-0c048ef2d2e5] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:48:21.506968 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-90c50898-d435-4fea-b230-c5557ce70079 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:21.507456 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-90c50898-d435-4fea-b230-c5557ce70079 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:21.508172 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-90c50898-d435-4fea-b230-c5557ce70079 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:21.508652 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-90c50898-d435-4fea-b230-c5557ce70079 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:21.570587 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-90c50898-d435-4fea-b230-c5557ce70079 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] [instance: d3834ee5-6837-4b8d-abb2-0c048ef2d2e5] Going to try to terminate instance {{(pid=113021) delete /opt/stack/nova/nova/compute/api.py:2539}} May 27 03:48:21.757592 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-26fb3490-9ff6-48d2-927a-c950eb4b0519 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:48:21.758203 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-26fb3490-9ff6-48d2-927a-c950eb4b0519 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] [instance: daffe717-7636-45e8-813d-8b2a6075c61e] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:48:21.765511 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-26fb3490-9ff6-48d2-927a-c950eb4b0519 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:21.770928 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-26fb3490-9ff6-48d2-927a-c950eb4b0519 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:21.770928 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-26fb3490-9ff6-48d2-927a-c950eb4b0519 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:21.770928 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-26fb3490-9ff6-48d2-927a-c950eb4b0519 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:21.874781 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-90c50898-d435-4fea-b230-c5557ce70079 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d3834ee5-6837-4b8d-abb2-0c048ef2d2e5" status: 204 len: 0 microversion: 2.1 time: 0.379555 May 27 03:48:21.875394 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 478/1006] 10.222.0.25 () {58 vars in 1239 bytes} [Thu May 27 03:48:21 2021] DELETE /compute/v2.1/servers/d3834ee5-6837-4b8d-abb2-0c048ef2d2e5 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 03:48:21.884263 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-ef10fc8d-49a4-4806-99d4-2024c85dd8f8 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:48:21.885639 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-ef10fc8d-49a4-4806-99d4-2024c85dd8f8 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] [instance: d3834ee5-6837-4b8d-abb2-0c048ef2d2e5] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:48:21.892974 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ef10fc8d-49a4-4806-99d4-2024c85dd8f8 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:21.893514 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ef10fc8d-49a4-4806-99d4-2024c85dd8f8 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:21.894384 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ef10fc8d-49a4-4806-99d4-2024c85dd8f8 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:21.894931 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ef10fc8d-49a4-4806-99d4-2024c85dd8f8 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:21.986152 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-26fb3490-9ff6-48d2-927a-c950eb4b0519 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf67cc7398a4e1cb6f565ebe2241e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df96baa86bb4c51b3b8bece28e3e23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:21.996839 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-26fb3490-9ff6-48d2-927a-c950eb4b0519 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] 10.222.0.25 "GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e" status: 200 len: 1754 microversion: 2.1 time: 0.243264 May 27 03:48:22.001795 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 529/1007] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:48:21 2021] GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e => generated 1754 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:48:22.121017 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-ef10fc8d-49a4-4806-99d4-2024c85dd8f8 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71289d2497de4089bfcdae8474859196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dc5f669f3f483bacc0bf258a11c302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:22.129201 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-ef10fc8d-49a4-4806-99d4-2024c85dd8f8 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] 10.222.0.25 "GET /compute/v2.1/servers/d3834ee5-6837-4b8d-abb2-0c048ef2d2e5" status: 200 len: 1513 microversion: 2.1 time: 0.249526 May 27 03:48:22.129773 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 479/1008] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:48:21 2021] GET /compute/v2.1/servers/d3834ee5-6837-4b8d-abb2-0c048ef2d2e5 => generated 1513 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:48:22.225222 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-0eb1ebc5-aaf1-4546-9de2-51d5938b491c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:48:22.225750 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-0eb1ebc5-aaf1-4546-9de2-51d5938b491c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:48:22.232935 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0eb1ebc5-aaf1-4546-9de2-51d5938b491c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:22.233383 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0eb1ebc5-aaf1-4546-9de2-51d5938b491c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:22.234139 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0eb1ebc5-aaf1-4546-9de2-51d5938b491c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:22.234572 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0eb1ebc5-aaf1-4546-9de2-51d5938b491c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:22.285064 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.wsgi [None req-0eb1ebc5-aaf1-4546-9de2-51d5938b491c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] HTTP exception thrown: Instance e367eb4b-29c5-4f41-b41d-0da84d751fe2 could not be found. May 27 03:48:22.285580 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-0eb1ebc5-aaf1-4546-9de2-51d5938b491c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Returning 404 to user: Instance e367eb4b-29c5-4f41-b41d-0da84d751fe2 could not be found. {{(pid=113020) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 27 03:48:22.286392 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-0eb1ebc5-aaf1-4546-9de2-51d5938b491c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 404 len: 111 microversion: 2.20 time: 0.065713 May 27 03:48:22.287415 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 530/1009] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:48:22 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 27 03:48:22.295760 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-d817875f-26e5-4476-901a-ab8806f2f77b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '.version_select at 0x7f988805d8b0>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:48:22.368054 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-d817875f-26e5-4476-901a-ab8806f2f77b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-904272356" status: 204 len: 0 microversion: 2.20 time: 0.075948 May 27 03:48:22.368651 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 480/1010] 10.222.0.25 () {60 vars in 1259 bytes} [Thu May 27 03:48:22 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-904272356 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 27 03:48:23.014050 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-9d193e66-ad17-4b83-b2c7-8debbe9340b3 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:48:23.014665 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-9d193e66-ad17-4b83-b2c7-8debbe9340b3 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] [instance: daffe717-7636-45e8-813d-8b2a6075c61e] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:48:23.022472 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9d193e66-ad17-4b83-b2c7-8debbe9340b3 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:23.022918 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9d193e66-ad17-4b83-b2c7-8debbe9340b3 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:23.023683 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9d193e66-ad17-4b83-b2c7-8debbe9340b3 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:23.024111 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9d193e66-ad17-4b83-b2c7-8debbe9340b3 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:23.146749 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-cf262c70-e2c3-4045-bdf4-edbb37f3ab5e tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:48:23.147271 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-cf262c70-e2c3-4045-bdf4-edbb37f3ab5e tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] [instance: d3834ee5-6837-4b8d-abb2-0c048ef2d2e5] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:48:23.154733 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-cf262c70-e2c3-4045-bdf4-edbb37f3ab5e tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:23.155222 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-cf262c70-e2c3-4045-bdf4-edbb37f3ab5e tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:23.156009 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-cf262c70-e2c3-4045-bdf4-edbb37f3ab5e tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:23.156475 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-cf262c70-e2c3-4045-bdf4-edbb37f3ab5e tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:23.355497 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-cf262c70-e2c3-4045-bdf4-edbb37f3ab5e tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71289d2497de4089bfcdae8474859196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dc5f669f3f483bacc0bf258a11c302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:23.363862 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-cf262c70-e2c3-4045-bdf4-edbb37f3ab5e tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] 10.222.0.25 "GET /compute/v2.1/servers/d3834ee5-6837-4b8d-abb2-0c048ef2d2e5" status: 200 len: 1513 microversion: 2.1 time: 0.220912 May 27 03:48:23.364458 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 481/1011] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:48:23 2021] GET /compute/v2.1/servers/d3834ee5-6837-4b8d-abb2-0c048ef2d2e5 => generated 1513 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:48:23.403229 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-9d193e66-ad17-4b83-b2c7-8debbe9340b3 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf67cc7398a4e1cb6f565ebe2241e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df96baa86bb4c51b3b8bece28e3e23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:23.409454 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-9d193e66-ad17-4b83-b2c7-8debbe9340b3 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] 10.222.0.25 "GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e" status: 200 len: 1757 microversion: 2.1 time: 0.399024 May 27 03:48:23.410172 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 531/1012] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:48:23 2021] GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e => generated 1757 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:48:23.765901 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-2bef7496-5413-46ba-91ce-679ae251db28 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'create', calling method: .version_select at 0x7f988805d430>, body: {"keypair": {"name": "tempest-keypair-1612966939"}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:48:23.787949 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.quota [None req-2bef7496-5413-46ba-91ce-679ae251db28 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Getting quotas for project 16ccb2756adb4055942bd0a0f0a061f4. Resources: {'key_pairs'} {{(pid=113021) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 27 03:48:23.791783 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.quota [None req-2bef7496-5413-46ba-91ce-679ae251db28 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Getting quotas for user e44e0bf02c8a48b1a5bbbfd71f2281bb and project 16ccb2756adb4055942bd0a0f0a061f4. Resources: {'key_pairs'} {{(pid=113021) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 27 03:48:24.260169 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.quota [None req-2bef7496-5413-46ba-91ce-679ae251db28 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Getting quotas for project 16ccb2756adb4055942bd0a0f0a061f4. Resources: {'key_pairs'} {{(pid=113021) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 27 03:48:24.264129 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.quota [None req-2bef7496-5413-46ba-91ce-679ae251db28 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Getting quotas for user e44e0bf02c8a48b1a5bbbfd71f2281bb and project 16ccb2756adb4055942bd0a0f0a061f4. Resources: {'key_pairs'} {{(pid=113021) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 27 03:48:24.276657 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-2bef7496-5413-46ba-91ce-679ae251db28 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.514517 May 27 03:48:24.277255 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 482/1013] 10.222.0.25 () {62 vars in 1199 bytes} [Thu May 27 03:48:23 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 516 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) May 27 03:48:24.381483 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-616e5dc1-b1c9-4a98-946a-4495480d0497 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:48:24.382096 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-616e5dc1-b1c9-4a98-946a-4495480d0497 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] [instance: d3834ee5-6837-4b8d-abb2-0c048ef2d2e5] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:48:24.390683 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-616e5dc1-b1c9-4a98-946a-4495480d0497 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:24.391485 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-616e5dc1-b1c9-4a98-946a-4495480d0497 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:24.395768 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-616e5dc1-b1c9-4a98-946a-4495480d0497 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:24.395768 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-616e5dc1-b1c9-4a98-946a-4495480d0497 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:24.618751 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-616e5dc1-b1c9-4a98-946a-4495480d0497 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71289d2497de4089bfcdae8474859196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dc5f669f3f483bacc0bf258a11c302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:24.635026 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-616e5dc1-b1c9-4a98-946a-4495480d0497 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] 10.222.0.25 "GET /compute/v2.1/servers/d3834ee5-6837-4b8d-abb2-0c048ef2d2e5" status: 200 len: 1513 microversion: 2.1 time: 0.255492 May 27 03:48:24.642340 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 532/1014] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:48:24 2021] GET /compute/v2.1/servers/d3834ee5-6837-4b8d-abb2-0c048ef2d2e5 => generated 1513 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:48:24.725308 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [req-ea5e0d00-b2e8-4baa-9173-3364ac3434c2 req-269ffb80-d43f-48b2-b694-1d4f5e751864 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3834ee5-6837-4b8d-abb2-0c048ef2d2e5", "name": "network-vif-deleted", "tag": "d711e7b6-b731-4377-8814-b74e7863713f"}]} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:48:24.727352 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:48:24.727352 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: warnings.warn(msg) May 27 03:48:24.736971 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-ea5e0d00-b2e8-4baa-9173-3364ac3434c2 req-269ffb80-d43f-48b2-b694-1d4f5e751864 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:24.737525 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-ea5e0d00-b2e8-4baa-9173-3364ac3434c2 req-269ffb80-d43f-48b2-b694-1d4f5e751864 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:24.753340 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.compute.server_external_events [req-ea5e0d00-b2e8-4baa-9173-3364ac3434c2 req-269ffb80-d43f-48b2-b694-1d4f5e751864 service nova] Creating event network-vif-deleted:d711e7b6-b731-4377-8814-b74e7863713f for instance d3834ee5-6837-4b8d-abb2-0c048ef2d2e5 on hv-cinder-79326 May 27 03:48:24.758201 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [req-ea5e0d00-b2e8-4baa-9173-3364ac3434c2 req-269ffb80-d43f-48b2-b694-1d4f5e751864 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040535 May 27 03:48:24.759111 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 483/1015] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:48:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:48:25.652328 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-a874e127-c938-4916-8a65-9cb24408db35 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:48:25.653131 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-a874e127-c938-4916-8a65-9cb24408db35 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] [instance: d3834ee5-6837-4b8d-abb2-0c048ef2d2e5] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:48:25.660891 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a874e127-c938-4916-8a65-9cb24408db35 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:25.661332 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a874e127-c938-4916-8a65-9cb24408db35 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:25.662094 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a874e127-c938-4916-8a65-9cb24408db35 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:25.662529 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a874e127-c938-4916-8a65-9cb24408db35 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:25.734802 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a874e127-c938-4916-8a65-9cb24408db35 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:25.735260 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a874e127-c938-4916-8a65-9cb24408db35 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:25.735721 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.objects.instance [None req-a874e127-c938-4916-8a65-9cb24408db35 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lazy-loading 'fault' on Instance uuid d3834ee5-6837-4b8d-abb2-0c048ef2d2e5 {{(pid=113020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 27 03:48:25.831981 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-a874e127-c938-4916-8a65-9cb24408db35 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71289d2497de4089bfcdae8474859196', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00dc5f669f3f483bacc0bf258a11c302', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:25.839681 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-a874e127-c938-4916-8a65-9cb24408db35 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] 10.222.0.25 "GET /compute/v2.1/servers/d3834ee5-6837-4b8d-abb2-0c048ef2d2e5" status: 200 len: 1309 microversion: 2.1 time: 0.191109 May 27 03:48:25.840245 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 533/1016] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:48:25 2021] GET /compute/v2.1/servers/d3834ee5-6837-4b8d-abb2-0c048ef2d2e5 => generated 1309 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:48:26.857150 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-a7e0a479-0264-424e-a331-d27d624e5297 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:48:26.857963 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-a7e0a479-0264-424e-a331-d27d624e5297 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] [instance: d3834ee5-6837-4b8d-abb2-0c048ef2d2e5] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:48:26.866104 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a7e0a479-0264-424e-a331-d27d624e5297 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:26.867040 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a7e0a479-0264-424e-a331-d27d624e5297 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:26.867904 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a7e0a479-0264-424e-a331-d27d624e5297 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:26.868469 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a7e0a479-0264-424e-a331-d27d624e5297 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:26.920321 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.wsgi [None req-a7e0a479-0264-424e-a331-d27d624e5297 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] HTTP exception thrown: Instance d3834ee5-6837-4b8d-abb2-0c048ef2d2e5 could not be found. May 27 03:48:26.920967 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-a7e0a479-0264-424e-a331-d27d624e5297 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] Returning 404 to user: Instance d3834ee5-6837-4b8d-abb2-0c048ef2d2e5 could not be found. {{(pid=113021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 27 03:48:26.921815 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-a7e0a479-0264-424e-a331-d27d624e5297 tempest-VolumesSnapshotTestJSON-1430919308 tempest-VolumesSnapshotTestJSON-1430919308-project] 10.222.0.25 "GET /compute/v2.1/servers/d3834ee5-6837-4b8d-abb2-0c048ef2d2e5" status: 404 len: 111 microversion: 2.1 time: 0.069014 May 27 03:48:26.925572 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 484/1017] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:48:26 2021] GET /compute/v2.1/servers/d3834ee5-6837-4b8d-abb2-0c048ef2d2e5 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:48:27.102159 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-3717ed7c-79fc-4049-8df8-2697e6c2a82e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-952931727", "imageRef": "78c0913d-0e41-4b41-b38f-f45c4f2535ff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f65a0cca-1ebc-4ae6-b01b-5fdf0f05198a"}], "security_groups": [{"name": "tempest-securitygroup--1056763105"}], "key_name": "tempest-keypair-1612966939", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:48:27.293312 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.network.neutron [None req-3717ed7c-79fc-4049-8df8-2697e6c2a82e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] validate_networks() for [('f65a0cca-1ebc-4ae6-b01b-5fdf0f05198a', None, None, None)] {{(pid=113020) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 27 03:48:28.015947 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.virt.hardware [None req-3717ed7c-79fc-4049-8df8-2697e6c2a82e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Flavor limits 0:0:0 {{(pid=113020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 27 03:48:28.016375 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.virt.hardware [None req-3717ed7c-79fc-4049-8df8-2697e6c2a82e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Image limits 0:0:0 {{(pid=113020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 27 03:48:28.016880 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.virt.hardware [None req-3717ed7c-79fc-4049-8df8-2697e6c2a82e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Flavor pref 0:0:0 {{(pid=113020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 27 03:48:28.017288 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.virt.hardware [None req-3717ed7c-79fc-4049-8df8-2697e6c2a82e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Image pref 0:0:0 {{(pid=113020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 27 03:48:28.017701 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.virt.hardware [None req-3717ed7c-79fc-4049-8df8-2697e6c2a82e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=113020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 27 03:48:28.025916 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3717ed7c-79fc-4049-8df8-2697e6c2a82e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:28.026358 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3717ed7c-79fc-4049-8df8-2697e6c2a82e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:28.027151 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3717ed7c-79fc-4049-8df8-2697e6c2a82e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:28.027588 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3717ed7c-79fc-4049-8df8-2697e6c2a82e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:28.044208 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.quota [None req-3717ed7c-79fc-4049-8df8-2697e6c2a82e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Getting quotas for project 16ccb2756adb4055942bd0a0f0a061f4. Resources: {'instances', 'cores', 'ram'} {{(pid=113020) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 27 03:48:28.048113 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.quota [None req-3717ed7c-79fc-4049-8df8-2697e6c2a82e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Getting quotas for user e44e0bf02c8a48b1a5bbbfd71f2281bb and project 16ccb2756adb4055942bd0a0f0a061f4. Resources: {'instances', 'cores', 'ram'} {{(pid=113020) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 27 03:48:28.059857 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-3717ed7c-79fc-4049-8df8-2697e6c2a82e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Going to run 1 instances... {{(pid=113020) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 27 03:48:28.062146 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-3717ed7c-79fc-4049-8df8-2697e6c2a82e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78c0913d-0e41-4b41-b38f-f45c4f2535ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=113020) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 27 03:48:28.201671 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-3717ed7c-79fc-4049-8df8-2697e6c2a82e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.103454 May 27 03:48:28.202291 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 534/1018] 10.222.0.25 () {62 vars in 1188 bytes} [Thu May 27 03:48:27 2021] POST /compute/v2.1/servers => generated 402 bytes in 1105 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 27 03:48:28.212351 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-0ccc130a-1aa3-4614-97e6-658cde272475 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:48:28.212998 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-0ccc130a-1aa3-4614-97e6-658cde272475 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:48:28.297649 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-0ccc130a-1aa3-4614-97e6-658cde272475 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:28.306179 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-0ccc130a-1aa3-4614-97e6-658cde272475 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:28.307703 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-0ccc130a-1aa3-4614-97e6-658cde272475 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:28.308805 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-0ccc130a-1aa3-4614-97e6-658cde272475 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 200 len: 1281 microversion: 2.20 time: 0.100220 May 27 03:48:28.309355 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 485/1019] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:48:28 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 1281 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:48:29.326124 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-5917db4b-695a-4ba1-ad0a-98aee9d9b9fa tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:48:29.326741 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-5917db4b-695a-4ba1-ad0a-98aee9d9b9fa tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:48:29.334075 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-5917db4b-695a-4ba1-ad0a-98aee9d9b9fa tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:29.334535 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-5917db4b-695a-4ba1-ad0a-98aee9d9b9fa tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:29.335317 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-5917db4b-695a-4ba1-ad0a-98aee9d9b9fa tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:29.335759 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-5917db4b-695a-4ba1-ad0a-98aee9d9b9fa tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:29.451451 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-5917db4b-695a-4ba1-ad0a-98aee9d9b9fa tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:29.460306 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-5917db4b-695a-4ba1-ad0a-98aee9d9b9fa tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:29.461897 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-5917db4b-695a-4ba1-ad0a-98aee9d9b9fa tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:29.463052 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-5917db4b-695a-4ba1-ad0a-98aee9d9b9fa tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 200 len: 1277 microversion: 2.20 time: 0.140785 May 27 03:48:29.463614 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 535/1020] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:48:29 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 1277 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:48:30.481622 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-a659be95-4f62-488b-9ea9-44c69caeea94 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:48:30.482245 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-a659be95-4f62-488b-9ea9-44c69caeea94 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:48:30.493201 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a659be95-4f62-488b-9ea9-44c69caeea94 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:30.493738 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a659be95-4f62-488b-9ea9-44c69caeea94 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:30.494516 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a659be95-4f62-488b-9ea9-44c69caeea94 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:30.495007 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a659be95-4f62-488b-9ea9-44c69caeea94 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:30.626786 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-a659be95-4f62-488b-9ea9-44c69caeea94 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:30.635821 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-a659be95-4f62-488b-9ea9-44c69caeea94 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:30.637466 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-a659be95-4f62-488b-9ea9-44c69caeea94 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:30.638544 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-a659be95-4f62-488b-9ea9-44c69caeea94 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 200 len: 1339 microversion: 2.20 time: 0.160818 May 27 03:48:30.639100 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 486/1021] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:48:30 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 1339 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:48:31.656529 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-c885d3e8-ba4a-4a1d-83fe-b661f0c6df5b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:48:31.657073 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-c885d3e8-ba4a-4a1d-83fe-b661f0c6df5b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:48:31.664692 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c885d3e8-ba4a-4a1d-83fe-b661f0c6df5b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:31.665140 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c885d3e8-ba4a-4a1d-83fe-b661f0c6df5b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:31.665902 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c885d3e8-ba4a-4a1d-83fe-b661f0c6df5b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:31.666343 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c885d3e8-ba4a-4a1d-83fe-b661f0c6df5b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:31.855681 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-c885d3e8-ba4a-4a1d-83fe-b661f0c6df5b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:31.864288 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-c885d3e8-ba4a-4a1d-83fe-b661f0c6df5b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:31.865827 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-c885d3e8-ba4a-4a1d-83fe-b661f0c6df5b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:31.867474 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-c885d3e8-ba4a-4a1d-83fe-b661f0c6df5b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 200 len: 1407 microversion: 2.20 time: 0.214202 May 27 03:48:31.868033 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 536/1022] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:48:31 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 1407 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:48:32.885397 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-479c7901-c848-44ff-85a8-638772cf7ff0 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:48:32.887832 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-479c7901-c848-44ff-85a8-638772cf7ff0 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:48:32.895169 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-479c7901-c848-44ff-85a8-638772cf7ff0 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:32.895894 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-479c7901-c848-44ff-85a8-638772cf7ff0 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:32.896738 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-479c7901-c848-44ff-85a8-638772cf7ff0 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:32.897341 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-479c7901-c848-44ff-85a8-638772cf7ff0 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:33.260148 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-479c7901-c848-44ff-85a8-638772cf7ff0 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:33.268810 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-479c7901-c848-44ff-85a8-638772cf7ff0 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:33.270334 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-479c7901-c848-44ff-85a8-638772cf7ff0 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:33.271408 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-479c7901-c848-44ff-85a8-638772cf7ff0 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 200 len: 1407 microversion: 2.20 time: 0.390077 May 27 03:48:33.271960 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 487/1023] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:48:32 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 1407 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:48:33.334384 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [req-af0f2773-7e19-49be-9bca-fbf527f09f1a req-b4f37364-c732-4802-b2e0-f1a758cb80d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaf24d29-a180-44ed-9549-e4cca130f813", "tag": "99d7c768-f910-47b6-ae4b-dc6dede2eec8"}]} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:48:33.337848 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:48:33.337848 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: warnings.warn(msg) May 27 03:48:33.351058 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-af0f2773-7e19-49be-9bca-fbf527f09f1a req-b4f37364-c732-4802-b2e0-f1a758cb80d1 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:33.351610 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-af0f2773-7e19-49be-9bca-fbf527f09f1a req-b4f37364-c732-4802-b2e0-f1a758cb80d1 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:33.368614 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.compute.server_external_events [req-af0f2773-7e19-49be-9bca-fbf527f09f1a req-b4f37364-c732-4802-b2e0-f1a758cb80d1 service nova] Creating event network-changed:99d7c768-f910-47b6-ae4b-dc6dede2eec8 for instance aaf24d29-a180-44ed-9549-e4cca130f813 on hv-cinder-79326 May 27 03:48:33.373674 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [req-af0f2773-7e19-49be-9bca-fbf527f09f1a req-b4f37364-c732-4802-b2e0-f1a758cb80d1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042853 May 27 03:48:33.374613 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 537/1024] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:48:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:48:34.290505 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-00c4940e-8995-4610-afe8-97c6a7baaa71 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:48:34.291126 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-00c4940e-8995-4610-afe8-97c6a7baaa71 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:48:34.298571 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-00c4940e-8995-4610-afe8-97c6a7baaa71 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:34.299032 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-00c4940e-8995-4610-afe8-97c6a7baaa71 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:34.299813 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-00c4940e-8995-4610-afe8-97c6a7baaa71 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:34.300261 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-00c4940e-8995-4610-afe8-97c6a7baaa71 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:34.578558 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-00c4940e-8995-4610-afe8-97c6a7baaa71 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:34.587848 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-00c4940e-8995-4610-afe8-97c6a7baaa71 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:34.589421 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-00c4940e-8995-4610-afe8-97c6a7baaa71 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:34.590509 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-00c4940e-8995-4610-afe8-97c6a7baaa71 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 200 len: 1407 microversion: 2.20 time: 0.304276 May 27 03:48:34.591069 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 488/1025] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:48:34 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 1407 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:48:35.608816 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-2a97d441-2007-43e0-b3b3-7de8dda65396 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:48:35.610271 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-2a97d441-2007-43e0-b3b3-7de8dda65396 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:48:35.618558 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-2a97d441-2007-43e0-b3b3-7de8dda65396 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:35.619110 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-2a97d441-2007-43e0-b3b3-7de8dda65396 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:35.620661 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-2a97d441-2007-43e0-b3b3-7de8dda65396 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:35.621111 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-2a97d441-2007-43e0-b3b3-7de8dda65396 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:35.824904 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-2a97d441-2007-43e0-b3b3-7de8dda65396 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:35.833828 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-2a97d441-2007-43e0-b3b3-7de8dda65396 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:35.835396 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-2a97d441-2007-43e0-b3b3-7de8dda65396 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:35.836505 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-2a97d441-2007-43e0-b3b3-7de8dda65396 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 200 len: 1407 microversion: 2.20 time: 0.231813 May 27 03:48:35.837065 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 538/1026] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:48:35 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 1407 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:48:36.854332 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-beb2ad69-05d8-48fc-853d-7497f3d79bc9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:48:36.854938 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-beb2ad69-05d8-48fc-853d-7497f3d79bc9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:48:36.862125 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-beb2ad69-05d8-48fc-853d-7497f3d79bc9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:36.862576 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-beb2ad69-05d8-48fc-853d-7497f3d79bc9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:36.863336 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-beb2ad69-05d8-48fc-853d-7497f3d79bc9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:36.863778 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-beb2ad69-05d8-48fc-853d-7497f3d79bc9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:37.066335 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-beb2ad69-05d8-48fc-853d-7497f3d79bc9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:37.075555 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-beb2ad69-05d8-48fc-853d-7497f3d79bc9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:37.077168 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-beb2ad69-05d8-48fc-853d-7497f3d79bc9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:37.078201 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-beb2ad69-05d8-48fc-853d-7497f3d79bc9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 200 len: 1407 microversion: 2.20 time: 0.227574 May 27 03:48:37.078763 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 489/1027] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:48:36 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 1407 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:48:38.096316 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-daa68e5d-29b8-4d95-90d2-fe2654a6f926 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:48:38.097004 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-daa68e5d-29b8-4d95-90d2-fe2654a6f926 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:48:38.104332 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-daa68e5d-29b8-4d95-90d2-fe2654a6f926 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:38.104810 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-daa68e5d-29b8-4d95-90d2-fe2654a6f926 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:38.105607 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-daa68e5d-29b8-4d95-90d2-fe2654a6f926 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:38.106046 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-daa68e5d-29b8-4d95-90d2-fe2654a6f926 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:38.306095 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-daa68e5d-29b8-4d95-90d2-fe2654a6f926 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:38.314746 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-daa68e5d-29b8-4d95-90d2-fe2654a6f926 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:38.316301 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-daa68e5d-29b8-4d95-90d2-fe2654a6f926 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:38.317394 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-daa68e5d-29b8-4d95-90d2-fe2654a6f926 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 200 len: 1407 microversion: 2.20 time: 0.224962 May 27 03:48:38.317945 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 539/1028] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:48:38 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 1407 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:48:39.334696 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-2c05a7cd-4b53-47c2-a26a-cd4f9df26c51 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:48:39.335307 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-2c05a7cd-4b53-47c2-a26a-cd4f9df26c51 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:48:39.342644 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2c05a7cd-4b53-47c2-a26a-cd4f9df26c51 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:39.343101 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2c05a7cd-4b53-47c2-a26a-cd4f9df26c51 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:39.343867 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2c05a7cd-4b53-47c2-a26a-cd4f9df26c51 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:39.344304 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2c05a7cd-4b53-47c2-a26a-cd4f9df26c51 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:39.547857 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-2c05a7cd-4b53-47c2-a26a-cd4f9df26c51 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:39.555591 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-2c05a7cd-4b53-47c2-a26a-cd4f9df26c51 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:39.557152 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-2c05a7cd-4b53-47c2-a26a-cd4f9df26c51 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:39.558238 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-2c05a7cd-4b53-47c2-a26a-cd4f9df26c51 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 200 len: 1407 microversion: 2.20 time: 0.227170 May 27 03:48:39.558783 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 490/1029] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:48:39 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 1407 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:48:40.576379 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-50ddc759-ae27-485a-91d7-bc9b27fa1827 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:48:40.577011 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-50ddc759-ae27-485a-91d7-bc9b27fa1827 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:48:40.584530 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-50ddc759-ae27-485a-91d7-bc9b27fa1827 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:40.585036 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-50ddc759-ae27-485a-91d7-bc9b27fa1827 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:40.585859 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-50ddc759-ae27-485a-91d7-bc9b27fa1827 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:40.586299 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-50ddc759-ae27-485a-91d7-bc9b27fa1827 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:40.782284 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-50ddc759-ae27-485a-91d7-bc9b27fa1827 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:40.791250 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-50ddc759-ae27-485a-91d7-bc9b27fa1827 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:40.792793 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-50ddc759-ae27-485a-91d7-bc9b27fa1827 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:40.793874 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-50ddc759-ae27-485a-91d7-bc9b27fa1827 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 200 len: 1407 microversion: 2.20 time: 0.221234 May 27 03:48:40.794433 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 540/1030] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:48:40 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 1407 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:48:41.812311 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-d001c36f-8f57-4de7-a21b-6e39ac0076f2 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:48:41.813053 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-d001c36f-8f57-4de7-a21b-6e39ac0076f2 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:48:41.820433 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d001c36f-8f57-4de7-a21b-6e39ac0076f2 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:41.824364 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d001c36f-8f57-4de7-a21b-6e39ac0076f2 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:41.824364 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d001c36f-8f57-4de7-a21b-6e39ac0076f2 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:41.824364 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d001c36f-8f57-4de7-a21b-6e39ac0076f2 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:42.013999 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-d001c36f-8f57-4de7-a21b-6e39ac0076f2 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:42.023194 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-d001c36f-8f57-4de7-a21b-6e39ac0076f2 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:42.024767 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-d001c36f-8f57-4de7-a21b-6e39ac0076f2 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:42.025849 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-d001c36f-8f57-4de7-a21b-6e39ac0076f2 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 200 len: 1407 microversion: 2.20 time: 0.217292 May 27 03:48:42.026402 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 491/1031] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:48:41 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 1407 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:48:42.920442 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [req-7fec32a5-7adb-4f7a-81f5-4fe1f7b2d776 req-3ca23a94-0ede-4e6d-bfa7-cd6e290960df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaf24d29-a180-44ed-9549-e4cca130f813", "name": "network-vif-plugged", "status": "completed", "tag": "99d7c768-f910-47b6-ae4b-dc6dede2eec8"}]} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:48:42.922046 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:48:42.922046 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: warnings.warn(msg) May 27 03:48:42.930508 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-7fec32a5-7adb-4f7a-81f5-4fe1f7b2d776 req-3ca23a94-0ede-4e6d-bfa7-cd6e290960df service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:42.930955 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-7fec32a5-7adb-4f7a-81f5-4fe1f7b2d776 req-3ca23a94-0ede-4e6d-bfa7-cd6e290960df service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:42.949654 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.compute.server_external_events [req-7fec32a5-7adb-4f7a-81f5-4fe1f7b2d776 req-3ca23a94-0ede-4e6d-bfa7-cd6e290960df service nova] Creating event network-vif-plugged:99d7c768-f910-47b6-ae4b-dc6dede2eec8 for instance aaf24d29-a180-44ed-9549-e4cca130f813 on hv-cinder-79326 May 27 03:48:42.954389 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [req-7fec32a5-7adb-4f7a-81f5-4fe1f7b2d776 req-3ca23a94-0ede-4e6d-bfa7-cd6e290960df service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037629 May 27 03:48:42.954958 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 541/1032] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:48:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:48:43.043790 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-2d90b360-30c7-4a4a-a4ba-120a1f107b0c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:48:43.044410 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-2d90b360-30c7-4a4a-a4ba-120a1f107b0c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:48:43.051487 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2d90b360-30c7-4a4a-a4ba-120a1f107b0c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:43.051935 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2d90b360-30c7-4a4a-a4ba-120a1f107b0c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:43.052730 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2d90b360-30c7-4a4a-a4ba-120a1f107b0c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:43.053174 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2d90b360-30c7-4a4a-a4ba-120a1f107b0c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:43.251810 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-2d90b360-30c7-4a4a-a4ba-120a1f107b0c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:43.260491 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-2d90b360-30c7-4a4a-a4ba-120a1f107b0c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:43.262020 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-2d90b360-30c7-4a4a-a4ba-120a1f107b0c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:43.263096 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-2d90b360-30c7-4a4a-a4ba-120a1f107b0c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 200 len: 1407 microversion: 2.20 time: 0.223070 May 27 03:48:43.263644 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 492/1033] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:48:43 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 1407 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:48:44.281292 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-2e195682-a27c-4219-936f-98b0e4319d89 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:48:44.282024 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-2e195682-a27c-4219-936f-98b0e4319d89 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:48:44.290282 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-2e195682-a27c-4219-936f-98b0e4319d89 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:44.290733 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-2e195682-a27c-4219-936f-98b0e4319d89 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:44.291511 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-2e195682-a27c-4219-936f-98b0e4319d89 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:44.291949 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-2e195682-a27c-4219-936f-98b0e4319d89 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:44.485240 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-2e195682-a27c-4219-936f-98b0e4319d89 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:44.493864 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-2e195682-a27c-4219-936f-98b0e4319d89 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:44.495391 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-2e195682-a27c-4219-936f-98b0e4319d89 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:44.496489 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-2e195682-a27c-4219-936f-98b0e4319d89 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 200 len: 1407 microversion: 2.20 time: 0.219268 May 27 03:48:44.497050 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 542/1034] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:48:44 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 1407 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:48:45.514549 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-ec2b3cd7-0450-4c6f-9b3c-ec1c4bd125b3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:48:45.515087 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-ec2b3cd7-0450-4c6f-9b3c-ec1c4bd125b3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:48:45.522356 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ec2b3cd7-0450-4c6f-9b3c-ec1c4bd125b3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:45.522821 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ec2b3cd7-0450-4c6f-9b3c-ec1c4bd125b3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:45.523594 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ec2b3cd7-0450-4c6f-9b3c-ec1c4bd125b3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:45.524065 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ec2b3cd7-0450-4c6f-9b3c-ec1c4bd125b3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:45.714249 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-ec2b3cd7-0450-4c6f-9b3c-ec1c4bd125b3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:45.722851 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-ec2b3cd7-0450-4c6f-9b3c-ec1c4bd125b3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:45.724380 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-ec2b3cd7-0450-4c6f-9b3c-ec1c4bd125b3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:45.725534 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-ec2b3cd7-0450-4c6f-9b3c-ec1c4bd125b3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 200 len: 1407 microversion: 2.20 time: 0.214841 May 27 03:48:45.726601 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 493/1035] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:48:45 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 1407 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:48:46.743467 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-2230a893-b8ca-48f9-9c28-be077c230d11 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:48:46.744023 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-2230a893-b8ca-48f9-9c28-be077c230d11 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:48:46.751268 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-2230a893-b8ca-48f9-9c28-be077c230d11 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:46.751716 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-2230a893-b8ca-48f9-9c28-be077c230d11 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:46.752519 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-2230a893-b8ca-48f9-9c28-be077c230d11 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:46.752957 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-2230a893-b8ca-48f9-9c28-be077c230d11 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:46.949707 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-2230a893-b8ca-48f9-9c28-be077c230d11 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:46.958350 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-2230a893-b8ca-48f9-9c28-be077c230d11 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:46.960589 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-2230a893-b8ca-48f9-9c28-be077c230d11 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:46.961660 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-2230a893-b8ca-48f9-9c28-be077c230d11 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 200 len: 1407 microversion: 2.20 time: 0.221983 May 27 03:48:46.962212 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 543/1036] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:48:46 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 1407 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:48:47.978734 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-2c6beb6e-273c-4c08-96ec-df281d55896b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:48:47.979440 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-2c6beb6e-273c-4c08-96ec-df281d55896b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:48:47.986814 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2c6beb6e-273c-4c08-96ec-df281d55896b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:47.987269 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2c6beb6e-273c-4c08-96ec-df281d55896b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:47.988039 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2c6beb6e-273c-4c08-96ec-df281d55896b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:47.988512 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2c6beb6e-273c-4c08-96ec-df281d55896b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:48.177948 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-2c6beb6e-273c-4c08-96ec-df281d55896b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:48.187120 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-2c6beb6e-273c-4c08-96ec-df281d55896b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:48.188967 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-2c6beb6e-273c-4c08-96ec-df281d55896b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:48.190050 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-2c6beb6e-273c-4c08-96ec-df281d55896b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 200 len: 1407 microversion: 2.20 time: 0.215096 May 27 03:48:48.190607 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 494/1037] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:48:47 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 1407 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:48:49.207178 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-86ba6348-87d7-46a4-b388-7e8bb296da65 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:48:49.207734 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-86ba6348-87d7-46a4-b388-7e8bb296da65 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:48:49.215496 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-86ba6348-87d7-46a4-b388-7e8bb296da65 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:49.215950 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-86ba6348-87d7-46a4-b388-7e8bb296da65 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:49.216743 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-86ba6348-87d7-46a4-b388-7e8bb296da65 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:49.217183 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-86ba6348-87d7-46a4-b388-7e8bb296da65 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:49.498658 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-86ba6348-87d7-46a4-b388-7e8bb296da65 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:49.508827 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-86ba6348-87d7-46a4-b388-7e8bb296da65 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:49.510430 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-86ba6348-87d7-46a4-b388-7e8bb296da65 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:49.511888 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-86ba6348-87d7-46a4-b388-7e8bb296da65 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 200 len: 1407 microversion: 2.20 time: 0.308249 May 27 03:48:49.512555 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 544/1038] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:48:49 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 1407 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:48:50.529788 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-dacd8032-8d28-4a91-b57f-1a30c1dae6a1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:48:50.530434 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-dacd8032-8d28-4a91-b57f-1a30c1dae6a1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:48:50.538509 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-dacd8032-8d28-4a91-b57f-1a30c1dae6a1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:50.538967 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-dacd8032-8d28-4a91-b57f-1a30c1dae6a1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:50.539730 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-dacd8032-8d28-4a91-b57f-1a30c1dae6a1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:50.540164 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-dacd8032-8d28-4a91-b57f-1a30c1dae6a1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:50.805946 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-dacd8032-8d28-4a91-b57f-1a30c1dae6a1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:50.814560 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-dacd8032-8d28-4a91-b57f-1a30c1dae6a1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:50.816093 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-dacd8032-8d28-4a91-b57f-1a30c1dae6a1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:48:50.817264 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-dacd8032-8d28-4a91-b57f-1a30c1dae6a1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 200 len: 1599 microversion: 2.20 time: 0.291171 May 27 03:48:50.817820 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 495/1039] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:48:50 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 1599 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:48:50.835586 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-29e716c2-24cd-4cef-b952-d38850f774a8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:48:50.836090 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-29e716c2-24cd-4cef-b952-d38850f774a8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:48:50.843522 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-29e716c2-24cd-4cef-b952-d38850f774a8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:50.843982 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-29e716c2-24cd-4cef-b952-d38850f774a8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:50.844786 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-29e716c2-24cd-4cef-b952-d38850f774a8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:50.845230 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-29e716c2-24cd-4cef-b952-d38850f774a8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:50.987825 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-29e716c2-24cd-4cef-b952-d38850f774a8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.156539 May 27 03:48:50.988497 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 545/1040] 10.222.0.25 () {60 vars in 1316 bytes} [Thu May 27 03:48:50 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/os-interface => generated 284 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 03:48:52.597617 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-30e4d54f-b62d-4476-8a6a-23c5f32ca1e4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:48:52.600356 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-30e4d54f-b62d-4476-8a6a-23c5f32ca1e4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:48:52.611536 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-30e4d54f-b62d-4476-8a6a-23c5f32ca1e4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:52.612624 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-30e4d54f-b62d-4476-8a6a-23c5f32ca1e4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:52.614128 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-30e4d54f-b62d-4476-8a6a-23c5f32ca1e4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:52.614968 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-30e4d54f-b62d-4476-8a6a-23c5f32ca1e4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:52.659742 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [req-ec661062-799a-4fa0-b8bd-48a07379c80e req-94a4ef23-68cc-4b16-99df-eecc54a587ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaf24d29-a180-44ed-9549-e4cca130f813", "tag": "99d7c768-f910-47b6-ae4b-dc6dede2eec8"}]} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:48:52.661415 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:48:52.661415 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: warnings.warn(msg) May 27 03:48:52.669633 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-ec661062-799a-4fa0-b8bd-48a07379c80e req-94a4ef23-68cc-4b16-99df-eecc54a587ce service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:52.670084 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-ec661062-799a-4fa0-b8bd-48a07379c80e req-94a4ef23-68cc-4b16-99df-eecc54a587ce service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:52.686539 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.compute.server_external_events [req-ec661062-799a-4fa0-b8bd-48a07379c80e req-94a4ef23-68cc-4b16-99df-eecc54a587ce service nova] Creating event network-changed:99d7c768-f910-47b6-ae4b-dc6dede2eec8 for instance aaf24d29-a180-44ed-9549-e4cca130f813 on hv-cinder-79326 May 27 03:48:52.691117 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [req-ec661062-799a-4fa0-b8bd-48a07379c80e req-94a4ef23-68cc-4b16-99df-eecc54a587ce service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097775 May 27 03:48:52.691680 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 546/1041] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:48:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:48:52.750949 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-30e4d54f-b62d-4476-8a6a-23c5f32ca1e4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 200 len: 14 microversion: 2.20 time: 0.159080 May 27 03:48:52.754278 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 496/1042] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:48:52 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 14 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:48:53.763057 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-35ff5459-125b-4142-bb46-0e9d93f3fb87 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:48:53.764080 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-35ff5459-125b-4142-bb46-0e9d93f3fb87 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:48:53.771829 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-35ff5459-125b-4142-bb46-0e9d93f3fb87 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:53.772848 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-35ff5459-125b-4142-bb46-0e9d93f3fb87 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:53.773620 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-35ff5459-125b-4142-bb46-0e9d93f3fb87 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:53.774055 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-35ff5459-125b-4142-bb46-0e9d93f3fb87 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:53.866351 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-35ff5459-125b-4142-bb46-0e9d93f3fb87 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 200 len: 14 microversion: 2.20 time: 0.107315 May 27 03:48:53.867027 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 547/1043] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:48:53 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:48:54.878082 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-6d332e57-315c-4e16-bc0e-86e9939d8825 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:48:54.879097 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-6d332e57-315c-4e16-bc0e-86e9939d8825 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:48:54.889586 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6d332e57-315c-4e16-bc0e-86e9939d8825 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:54.889586 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6d332e57-315c-4e16-bc0e-86e9939d8825 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:54.889586 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6d332e57-315c-4e16-bc0e-86e9939d8825 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:54.889586 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6d332e57-315c-4e16-bc0e-86e9939d8825 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:54.987813 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-6d332e57-315c-4e16-bc0e-86e9939d8825 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 200 len: 14 microversion: 2.20 time: 0.113771 May 27 03:48:54.988412 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 497/1044] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:48:54 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 14 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:48:55.999234 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-e949e55b-4376-43b8-bbb9-58a1cc3f3aa1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:48:56.000278 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-e949e55b-4376-43b8-bbb9-58a1cc3f3aa1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:48:56.008693 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e949e55b-4376-43b8-bbb9-58a1cc3f3aa1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:56.009146 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e949e55b-4376-43b8-bbb9-58a1cc3f3aa1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:56.009911 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e949e55b-4376-43b8-bbb9-58a1cc3f3aa1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:56.010348 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e949e55b-4376-43b8-bbb9-58a1cc3f3aa1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:56.122341 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-e949e55b-4376-43b8-bbb9-58a1cc3f3aa1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 200 len: 14 microversion: 2.20 time: 0.127092 May 27 03:48:56.123142 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 548/1045] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:48:55 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 14 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:48:57.133512 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-c11b8346-7cd5-45b9-9739-6c239c6588b2 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:48:57.134529 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-c11b8346-7cd5-45b9-9739-6c239c6588b2 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:48:57.142330 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c11b8346-7cd5-45b9-9739-6c239c6588b2 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:57.142790 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c11b8346-7cd5-45b9-9739-6c239c6588b2 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:57.143605 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c11b8346-7cd5-45b9-9739-6c239c6588b2 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:57.144049 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c11b8346-7cd5-45b9-9739-6c239c6588b2 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:57.239111 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-c11b8346-7cd5-45b9-9739-6c239c6588b2 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 200 len: 14 microversion: 2.20 time: 0.109581 May 27 03:48:57.239637 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 498/1046] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:48:57 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:48:58.249783 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-e781d3e9-3948-4a8f-ad21-7390103d69df tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:48:58.250868 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-e781d3e9-3948-4a8f-ad21-7390103d69df tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:48:58.258682 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e781d3e9-3948-4a8f-ad21-7390103d69df tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:58.259137 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e781d3e9-3948-4a8f-ad21-7390103d69df tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:58.259918 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e781d3e9-3948-4a8f-ad21-7390103d69df tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:58.260359 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e781d3e9-3948-4a8f-ad21-7390103d69df tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:58.361781 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-e781d3e9-3948-4a8f-ad21-7390103d69df tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 200 len: 14 microversion: 2.20 time: 0.115833 May 27 03:48:58.362381 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 549/1047] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:48:58 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:48:59.373692 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-2ade837c-2414-4dcc-b450-b31003267a53 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:48:59.374743 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-2ade837c-2414-4dcc-b450-b31003267a53 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:48:59.383274 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2ade837c-2414-4dcc-b450-b31003267a53 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:59.383734 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2ade837c-2414-4dcc-b450-b31003267a53 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:59.384547 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2ade837c-2414-4dcc-b450-b31003267a53 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:48:59.384994 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2ade837c-2414-4dcc-b450-b31003267a53 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:48:59.480853 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-2ade837c-2414-4dcc-b450-b31003267a53 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 200 len: 14 microversion: 2.20 time: 0.111203 May 27 03:48:59.481461 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 499/1048] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:48:59 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 14 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:49:00.492480 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-1a751a9f-9c11-44b7-a69a-e18b2a728856 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:49:00.493495 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-1a751a9f-9c11-44b7-a69a-e18b2a728856 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:00.501947 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1a751a9f-9c11-44b7-a69a-e18b2a728856 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:00.501947 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1a751a9f-9c11-44b7-a69a-e18b2a728856 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:00.502563 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1a751a9f-9c11-44b7-a69a-e18b2a728856 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:00.503004 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1a751a9f-9c11-44b7-a69a-e18b2a728856 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:00.602914 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-1a751a9f-9c11-44b7-a69a-e18b2a728856 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 200 len: 14 microversion: 2.20 time: 0.114486 May 27 03:49:00.603516 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 550/1049] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:49:00 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 14 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:49:01.614762 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-fba8dbb2-193a-4db8-adf8-29a52a983155 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:49:01.615694 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-fba8dbb2-193a-4db8-adf8-29a52a983155 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:01.623534 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-fba8dbb2-193a-4db8-adf8-29a52a983155 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:01.623986 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-fba8dbb2-193a-4db8-adf8-29a52a983155 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:01.624782 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-fba8dbb2-193a-4db8-adf8-29a52a983155 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:01.625222 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-fba8dbb2-193a-4db8-adf8-29a52a983155 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:01.717191 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-fba8dbb2-193a-4db8-adf8-29a52a983155 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 200 len: 14 microversion: 2.20 time: 0.106516 May 27 03:49:01.717949 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 500/1050] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:49:01 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:49:02.729453 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-57e2c069-320d-486c-b7b5-bef8947e722e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:49:02.730483 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-57e2c069-320d-486c-b7b5-bef8947e722e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:02.738635 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-57e2c069-320d-486c-b7b5-bef8947e722e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:02.739080 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-57e2c069-320d-486c-b7b5-bef8947e722e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:02.739915 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-57e2c069-320d-486c-b7b5-bef8947e722e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:02.740347 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-57e2c069-320d-486c-b7b5-bef8947e722e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:02.844686 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-57e2c069-320d-486c-b7b5-bef8947e722e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 200 len: 8819 microversion: 2.20 time: 0.119921 May 27 03:49:02.845365 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 551/1051] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:49:02 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 8819 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:49:03.855940 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-a3a4a380-683d-4fc1-b191-d7865539d1b0 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:49:03.856981 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-a3a4a380-683d-4fc1-b191-d7865539d1b0 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:03.864899 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a3a4a380-683d-4fc1-b191-d7865539d1b0 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:03.865365 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a3a4a380-683d-4fc1-b191-d7865539d1b0 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:03.866620 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a3a4a380-683d-4fc1-b191-d7865539d1b0 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:03.867234 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a3a4a380-683d-4fc1-b191-d7865539d1b0 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:03.969175 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-a3a4a380-683d-4fc1-b191-d7865539d1b0 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 200 len: 16678 microversion: 2.20 time: 0.117121 May 27 03:49:03.970026 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 501/1052] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:49:03 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 16678 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:49:04.983054 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-1536a450-a2bb-4c68-bd1c-064cd2485479 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:49:04.983054 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-1536a450-a2bb-4c68-bd1c-064cd2485479 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:04.990680 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1536a450-a2bb-4c68-bd1c-064cd2485479 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:04.991186 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1536a450-a2bb-4c68-bd1c-064cd2485479 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:04.991998 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1536a450-a2bb-4c68-bd1c-064cd2485479 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:04.992504 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1536a450-a2bb-4c68-bd1c-064cd2485479 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:05.091801 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-1536a450-a2bb-4c68-bd1c-064cd2485479 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 200 len: 18561 microversion: 2.20 time: 0.114388 May 27 03:49:05.095648 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 552/1053] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:49:04 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 18561 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:49:06.106161 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-d7bc7d18-f408-4582-ac9d-e0c3300e381f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:49:06.107181 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-d7bc7d18-f408-4582-ac9d-e0c3300e381f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:06.115123 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d7bc7d18-f408-4582-ac9d-e0c3300e381f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:06.115573 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d7bc7d18-f408-4582-ac9d-e0c3300e381f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:06.116341 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d7bc7d18-f408-4582-ac9d-e0c3300e381f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:06.116924 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d7bc7d18-f408-4582-ac9d-e0c3300e381f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:06.354056 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-d7bc7d18-f408-4582-ac9d-e0c3300e381f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 200 len: 21463 microversion: 2.20 time: 0.254174 May 27 03:49:06.354657 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 502/1054] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:49:06 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 21463 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:49:07.365847 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-30375f7d-49e9-43ca-9dac-95ef1fdc3cf3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:49:07.366906 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-30375f7d-49e9-43ca-9dac-95ef1fdc3cf3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:07.377046 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-30375f7d-49e9-43ca-9dac-95ef1fdc3cf3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:07.377494 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-30375f7d-49e9-43ca-9dac-95ef1fdc3cf3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:07.378265 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-30375f7d-49e9-43ca-9dac-95ef1fdc3cf3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:07.378700 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-30375f7d-49e9-43ca-9dac-95ef1fdc3cf3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:07.476104 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-30375f7d-49e9-43ca-9dac-95ef1fdc3cf3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 200 len: 23188 microversion: 2.20 time: 0.114286 May 27 03:49:07.477637 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 553/1055] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:49:07 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 23188 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:49:08.488951 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-965132ad-495e-4b3e-ac2b-df3f560289dd tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:49:08.489981 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-965132ad-495e-4b3e-ac2b-df3f560289dd tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:08.498405 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-965132ad-495e-4b3e-ac2b-df3f560289dd tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:08.499280 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-965132ad-495e-4b3e-ac2b-df3f560289dd tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:08.499682 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-965132ad-495e-4b3e-ac2b-df3f560289dd tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:08.500122 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-965132ad-495e-4b3e-ac2b-df3f560289dd tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:12.129293 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-965132ad-495e-4b3e-ac2b-df3f560289dd tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 200 len: 27746 microversion: 2.20 time: 3.644260 May 27 03:49:12.129885 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 503/1056] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:49:08 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 27746 bytes in 3646 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:49:13.142499 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-bf2f1dc9-3c17-4f2f-8d24-6f919e867832 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:49:13.143620 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-bf2f1dc9-3c17-4f2f-8d24-6f919e867832 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:13.151421 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-bf2f1dc9-3c17-4f2f-8d24-6f919e867832 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:13.151868 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-bf2f1dc9-3c17-4f2f-8d24-6f919e867832 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:13.152669 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-bf2f1dc9-3c17-4f2f-8d24-6f919e867832 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:13.153127 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-bf2f1dc9-3c17-4f2f-8d24-6f919e867832 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:13.260923 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-bf2f1dc9-3c17-4f2f-8d24-6f919e867832 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 200 len: 27862 microversion: 2.20 time: 0.122377 May 27 03:49:13.261576 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 554/1057] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:49:13 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 27862 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:49:14.272781 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-4801b5ba-6130-4e5c-b664-119f29ea7907 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:49:14.274055 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-4801b5ba-6130-4e5c-b664-119f29ea7907 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:14.281932 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-4801b5ba-6130-4e5c-b664-119f29ea7907 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:14.282392 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-4801b5ba-6130-4e5c-b664-119f29ea7907 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:14.283441 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-4801b5ba-6130-4e5c-b664-119f29ea7907 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:14.283889 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-4801b5ba-6130-4e5c-b664-119f29ea7907 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:14.380779 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-4801b5ba-6130-4e5c-b664-119f29ea7907 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 200 len: 27989 microversion: 2.20 time: 0.111842 May 27 03:49:14.381418 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 504/1058] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:49:14 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 27989 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:49:15.393521 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-b9276e64-e173-4662-b57e-975c54bfe68e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:49:15.394571 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-b9276e64-e173-4662-b57e-975c54bfe68e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:15.403006 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b9276e64-e173-4662-b57e-975c54bfe68e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:15.403454 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b9276e64-e173-4662-b57e-975c54bfe68e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:15.404229 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b9276e64-e173-4662-b57e-975c54bfe68e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:15.404777 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b9276e64-e173-4662-b57e-975c54bfe68e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:15.505756 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-b9276e64-e173-4662-b57e-975c54bfe68e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 200 len: 28107 microversion: 2.20 time: 0.116176 May 27 03:49:15.506439 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 555/1059] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:49:15 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 28107 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:49:16.518230 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-6a4a21d2-cf54-4182-8df0-2ede9953f2ee tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:49:16.519273 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-6a4a21d2-cf54-4182-8df0-2ede9953f2ee tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:16.527680 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6a4a21d2-cf54-4182-8df0-2ede9953f2ee tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:16.528164 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6a4a21d2-cf54-4182-8df0-2ede9953f2ee tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:16.528981 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6a4a21d2-cf54-4182-8df0-2ede9953f2ee tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:16.530332 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6a4a21d2-cf54-4182-8df0-2ede9953f2ee tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:16.627921 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-6a4a21d2-cf54-4182-8df0-2ede9953f2ee tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 200 len: 28224 microversion: 2.20 time: 0.113683 May 27 03:49:16.628593 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 505/1060] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:49:16 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 28224 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:49:17.640799 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-3f1c74d2-c253-48ff-b537-7594dee97026 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:49:17.641898 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-3f1c74d2-c253-48ff-b537-7594dee97026 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:17.649740 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3f1c74d2-c253-48ff-b537-7594dee97026 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:17.650327 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3f1c74d2-c253-48ff-b537-7594dee97026 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:17.651167 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3f1c74d2-c253-48ff-b537-7594dee97026 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:17.651674 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3f1c74d2-c253-48ff-b537-7594dee97026 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:17.747653 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-3f1c74d2-c253-48ff-b537-7594dee97026 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 200 len: 28224 microversion: 2.20 time: 0.111083 May 27 03:49:17.748563 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 556/1061] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:49:17 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 28224 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:49:18.760557 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-0f481b30-1916-4ace-85c2-8d75175fb931 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:49:18.761563 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-0f481b30-1916-4ace-85c2-8d75175fb931 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:18.769348 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-0f481b30-1916-4ace-85c2-8d75175fb931 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:18.769794 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-0f481b30-1916-4ace-85c2-8d75175fb931 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:18.770562 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-0f481b30-1916-4ace-85c2-8d75175fb931 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:18.770999 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-0f481b30-1916-4ace-85c2-8d75175fb931 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:18.865144 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-0f481b30-1916-4ace-85c2-8d75175fb931 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 200 len: 28224 microversion: 2.20 time: 0.109278 May 27 03:49:18.865825 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 506/1062] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:49:18 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 28224 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:49:19.878214 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-c92a0261-ce68-4a9a-806a-4e2b213a7f08 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:49:19.879581 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-c92a0261-ce68-4a9a-806a-4e2b213a7f08 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:19.888365 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c92a0261-ce68-4a9a-806a-4e2b213a7f08 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:19.889352 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c92a0261-ce68-4a9a-806a-4e2b213a7f08 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:19.890483 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c92a0261-ce68-4a9a-806a-4e2b213a7f08 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:19.891146 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c92a0261-ce68-4a9a-806a-4e2b213a7f08 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:19.993925 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-c92a0261-ce68-4a9a-806a-4e2b213a7f08 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 200 len: 28224 microversion: 2.20 time: 0.119631 May 27 03:49:19.995262 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 557/1063] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:49:19 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 28224 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:49:21.007057 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-a3aef5e7-17ff-433e-89f2-647f348406a9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:49:21.009396 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-a3aef5e7-17ff-433e-89f2-647f348406a9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:21.017078 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a3aef5e7-17ff-433e-89f2-647f348406a9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:21.017635 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a3aef5e7-17ff-433e-89f2-647f348406a9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:21.018505 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a3aef5e7-17ff-433e-89f2-647f348406a9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:21.018891 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a3aef5e7-17ff-433e-89f2-647f348406a9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:21.122531 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-a3aef5e7-17ff-433e-89f2-647f348406a9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 200 len: 28224 microversion: 2.20 time: 0.119676 May 27 03:49:21.123208 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 507/1064] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:49:21 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 28224 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:49:22.136315 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-0553e2fd-144b-4faa-9151-e40af2173b63 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:49:22.137288 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-0553e2fd-144b-4faa-9151-e40af2173b63 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:22.145296 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0553e2fd-144b-4faa-9151-e40af2173b63 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:22.145752 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0553e2fd-144b-4faa-9151-e40af2173b63 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:22.146530 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0553e2fd-144b-4faa-9151-e40af2173b63 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:22.147061 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0553e2fd-144b-4faa-9151-e40af2173b63 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:22.245244 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-0553e2fd-144b-4faa-9151-e40af2173b63 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 200 len: 28224 microversion: 2.20 time: 0.113853 May 27 03:49:22.249221 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 558/1065] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:49:22 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 28224 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:49:23.257233 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-e5abc064-7cce-4a45-9a3d-2661af2aceb9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:49:23.258264 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-e5abc064-7cce-4a45-9a3d-2661af2aceb9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:23.266335 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e5abc064-7cce-4a45-9a3d-2661af2aceb9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:23.273207 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e5abc064-7cce-4a45-9a3d-2661af2aceb9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:23.273207 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e5abc064-7cce-4a45-9a3d-2661af2aceb9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:23.273207 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e5abc064-7cce-4a45-9a3d-2661af2aceb9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:23.364897 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-e5abc064-7cce-4a45-9a3d-2661af2aceb9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 200 len: 28224 microversion: 2.20 time: 0.111805 May 27 03:49:23.365539 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 508/1066] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:49:23 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 28224 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:49:24.377725 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-ba815900-a7f5-4f67-b467-4b17e4f42865 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:49:24.378760 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-ba815900-a7f5-4f67-b467-4b17e4f42865 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:24.386689 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ba815900-a7f5-4f67-b467-4b17e4f42865 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:24.387161 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ba815900-a7f5-4f67-b467-4b17e4f42865 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:24.388101 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ba815900-a7f5-4f67-b467-4b17e4f42865 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:24.388586 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ba815900-a7f5-4f67-b467-4b17e4f42865 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:24.485139 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-ba815900-a7f5-4f67-b467-4b17e4f42865 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 200 len: 28224 microversion: 2.20 time: 0.111409 May 27 03:49:24.486761 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 559/1067] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:49:24 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 28224 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:49:25.499055 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-c4d3bec9-d234-46be-9c2c-4a55058c046d tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:49:25.500956 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-c4d3bec9-d234-46be-9c2c-4a55058c046d tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:25.511273 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c4d3bec9-d234-46be-9c2c-4a55058c046d tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:25.512010 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c4d3bec9-d234-46be-9c2c-4a55058c046d tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:25.512908 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c4d3bec9-d234-46be-9c2c-4a55058c046d tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:25.513586 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c4d3bec9-d234-46be-9c2c-4a55058c046d tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:25.616987 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-c4d3bec9-d234-46be-9c2c-4a55058c046d tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 200 len: 28224 microversion: 2.20 time: 0.121745 May 27 03:49:25.617695 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 509/1068] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:49:25 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 28224 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 27 03:49:26.316343 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-9ff0b0a2-1bea-41bc-bed5-11b0099b9771 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:49:26.317558 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-9ff0b0a2-1bea-41bc-bed5-11b0099b9771 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:26.325988 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9ff0b0a2-1bea-41bc-bed5-11b0099b9771 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:26.326453 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9ff0b0a2-1bea-41bc-bed5-11b0099b9771 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:26.327239 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9ff0b0a2-1bea-41bc-bed5-11b0099b9771 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:26.327680 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9ff0b0a2-1bea-41bc-bed5-11b0099b9771 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:26.390258 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-9ff0b0a2-1bea-41bc-bed5-11b0099b9771 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Going to try to terminate instance {{(pid=113020) delete /opt/stack/nova/nova/compute/api.py:2539}} May 27 03:49:26.630238 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-dd45ca72-4aa8-4b36-be2a-95fef361eba3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:49:26.633156 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-dd45ca72-4aa8-4b36-be2a-95fef361eba3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:26.642257 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-dd45ca72-4aa8-4b36-be2a-95fef361eba3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:26.642703 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-dd45ca72-4aa8-4b36-be2a-95fef361eba3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:26.643557 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-dd45ca72-4aa8-4b36-be2a-95fef361eba3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:26.644003 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-dd45ca72-4aa8-4b36-be2a-95fef361eba3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:26.715416 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-9ff0b0a2-1bea-41bc-bed5-11b0099b9771 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 204 len: 0 microversion: 2.1 time: 0.402937 May 27 03:49:26.716016 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 560/1069] 10.222.0.25 () {58 vars in 1239 bytes} [Thu May 27 03:49:26 2021] DELETE /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 03:49:26.724471 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-e30fb970-2e4e-4ed4-9ff9-39c02d630027 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:49:26.725300 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-e30fb970-2e4e-4ed4-9ff9-39c02d630027 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:26.732652 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e30fb970-2e4e-4ed4-9ff9-39c02d630027 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:26.733211 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e30fb970-2e4e-4ed4-9ff9-39c02d630027 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:26.734144 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e30fb970-2e4e-4ed4-9ff9-39c02d630027 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:26.734679 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e30fb970-2e4e-4ed4-9ff9-39c02d630027 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:26.759252 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-dd45ca72-4aa8-4b36-be2a-95fef361eba3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 200 len: 28224 microversion: 2.20 time: 0.132383 May 27 03:49:26.761123 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 510/1070] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:49:26 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 28224 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 27 03:49:26.954500 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-e30fb970-2e4e-4ed4-9ff9-39c02d630027 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:49:26.964309 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-e30fb970-2e4e-4ed4-9ff9-39c02d630027 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1673 microversion: 2.1 time: 0.243610 May 27 03:49:26.965329 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 561/1071] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:49:26 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1673 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:49:27.773472 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-724a2274-0e33-43e9-a4d6-2dd3e172e29e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:49:27.774668 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-724a2274-0e33-43e9-a4d6-2dd3e172e29e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:27.783228 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-724a2274-0e33-43e9-a4d6-2dd3e172e29e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:27.783677 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-724a2274-0e33-43e9-a4d6-2dd3e172e29e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:27.784624 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-724a2274-0e33-43e9-a4d6-2dd3e172e29e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:27.785063 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-724a2274-0e33-43e9-a4d6-2dd3e172e29e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:27.982380 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-e5c26f7e-aca1-4391-b08c-3d7c6a506786 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:49:27.984037 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-e5c26f7e-aca1-4391-b08c-3d7c6a506786 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:27.993165 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e5c26f7e-aca1-4391-b08c-3d7c6a506786 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:27.993621 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e5c26f7e-aca1-4391-b08c-3d7c6a506786 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:27.994405 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e5c26f7e-aca1-4391-b08c-3d7c6a506786 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:27.994845 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e5c26f7e-aca1-4391-b08c-3d7c6a506786 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:28.021775 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-724a2274-0e33-43e9-a4d6-2dd3e172e29e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 200 len: 28224 microversion: 2.20 time: 0.253545 May 27 03:49:28.024181 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 511/1072] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:49:27 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 28224 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:49:28.505404 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-e5c26f7e-aca1-4391-b08c-3d7c6a506786 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:49:28.515138 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-e5c26f7e-aca1-4391-b08c-3d7c6a506786 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1673 microversion: 2.1 time: 0.536370 May 27 03:49:28.517085 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 562/1073] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:49:27 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1673 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:49:29.034731 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-6ac068a7-13d8-49ad-82de-8b582aebf142 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:49:29.039056 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-6ac068a7-13d8-49ad-82de-8b582aebf142 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:29.045185 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6ac068a7-13d8-49ad-82de-8b582aebf142 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:29.045782 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6ac068a7-13d8-49ad-82de-8b582aebf142 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:29.046677 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6ac068a7-13d8-49ad-82de-8b582aebf142 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:29.047282 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6ac068a7-13d8-49ad-82de-8b582aebf142 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:29.146148 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-6ac068a7-13d8-49ad-82de-8b582aebf142 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 200 len: 28224 microversion: 2.20 time: 0.115674 May 27 03:49:29.147134 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 512/1074] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:49:29 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 28224 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:49:29.533244 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-45ba6309-3362-4ece-8857-66e40d17c5eb tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:49:29.538982 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-45ba6309-3362-4ece-8857-66e40d17c5eb tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:29.543373 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-45ba6309-3362-4ece-8857-66e40d17c5eb tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:29.544126 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-45ba6309-3362-4ece-8857-66e40d17c5eb tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:29.545131 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-45ba6309-3362-4ece-8857-66e40d17c5eb tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:29.545730 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-45ba6309-3362-4ece-8857-66e40d17c5eb tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:29.876146 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [req-c31ea8c2-616d-4e05-a3f8-e14157857f85 req-24c70844-d7a6-413f-ab80-7622253dc8b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c7e656a-afc5-4119-a11e-920c583d89d2", "name": "network-vif-deleted", "tag": "24177437-ade1-43c7-bd7d-340757426924"}]} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:49:29.877510 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:49:29.877510 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: warnings.warn(msg) May 27 03:49:29.892190 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-c31ea8c2-616d-4e05-a3f8-e14157857f85 req-24c70844-d7a6-413f-ab80-7622253dc8b1 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:29.893282 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-c31ea8c2-616d-4e05-a3f8-e14157857f85 req-24c70844-d7a6-413f-ab80-7622253dc8b1 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:29.908138 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-45ba6309-3362-4ece-8857-66e40d17c5eb tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:49:29.915681 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.compute.server_external_events [req-c31ea8c2-616d-4e05-a3f8-e14157857f85 req-24c70844-d7a6-413f-ab80-7622253dc8b1 service nova] Creating event network-vif-deleted:24177437-ade1-43c7-bd7d-340757426924 for instance 3c7e656a-afc5-4119-a11e-920c583d89d2 on hv-cinder-79326 May 27 03:49:29.917164 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-45ba6309-3362-4ece-8857-66e40d17c5eb tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 200 len: 1606 microversion: 2.1 time: 0.387835 May 27 03:49:29.927636 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 563/1075] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:49:29 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 1606 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:49:29.929788 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [req-c31ea8c2-616d-4e05-a3f8-e14157857f85 req-24c70844-d7a6-413f-ab80-7622253dc8b1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057257 May 27 03:49:29.930647 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 513/1076] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:49:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:49:30.161505 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-8e2f9da0-f381-48f5-a983-86a98e3b6731 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:49:30.163490 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-8e2f9da0-f381-48f5-a983-86a98e3b6731 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:30.174849 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8e2f9da0-f381-48f5-a983-86a98e3b6731 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:30.175764 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8e2f9da0-f381-48f5-a983-86a98e3b6731 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:30.176736 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8e2f9da0-f381-48f5-a983-86a98e3b6731 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:30.177335 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8e2f9da0-f381-48f5-a983-86a98e3b6731 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:30.311884 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-8e2f9da0-f381-48f5-a983-86a98e3b6731 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 200 len: 28224 microversion: 2.20 time: 0.156761 May 27 03:49:30.312730 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 564/1077] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:49:30 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 28224 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:49:30.935799 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-b7fac6f9-544e-4fdc-b869-6aa0ec8d450e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:49:30.936828 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-b7fac6f9-544e-4fdc-b869-6aa0ec8d450e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:30.963280 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b7fac6f9-544e-4fdc-b869-6aa0ec8d450e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:30.964993 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b7fac6f9-544e-4fdc-b869-6aa0ec8d450e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:30.966290 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b7fac6f9-544e-4fdc-b869-6aa0ec8d450e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:30.967226 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b7fac6f9-544e-4fdc-b869-6aa0ec8d450e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:31.033519 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.wsgi [None req-b7fac6f9-544e-4fdc-b869-6aa0ec8d450e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] HTTP exception thrown: Instance 3c7e656a-afc5-4119-a11e-920c583d89d2 could not be found. May 27 03:49:31.035525 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-b7fac6f9-544e-4fdc-b869-6aa0ec8d450e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Returning 404 to user: Instance 3c7e656a-afc5-4119-a11e-920c583d89d2 could not be found. {{(pid=113021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 27 03:49:31.036583 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-b7fac6f9-544e-4fdc-b869-6aa0ec8d450e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 404 len: 111 microversion: 2.1 time: 0.105817 May 27 03:49:31.044556 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 514/1078] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:49:30 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:49:31.055113 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-cfb7fc0d-bc62-4c49-ae5d-3d4b36652e26 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '.version_select at 0x7f98889d6f70>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:49:31.185293 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-cfb7fc0d-bc62-4c49-ae5d-3d4b36652e26 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1730242496" status: 202 len: 0 microversion: 2.1 time: 0.139075 May 27 03:49:31.186159 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 565/1079] 10.222.0.25 () {58 vars in 1221 bytes} [Thu May 27 03:49:31 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1730242496 => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:49:31.329876 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-b7cecad5-183e-409b-9c48-10f4015a7e66 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:49:31.332222 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-b7cecad5-183e-409b-9c48-10f4015a7e66 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:31.342592 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b7cecad5-183e-409b-9c48-10f4015a7e66 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:31.344221 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b7cecad5-183e-409b-9c48-10f4015a7e66 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:31.345279 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b7cecad5-183e-409b-9c48-10f4015a7e66 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:31.345983 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b7cecad5-183e-409b-9c48-10f4015a7e66 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:31.461666 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-b7cecad5-183e-409b-9c48-10f4015a7e66 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 200 len: 28515 microversion: 2.20 time: 0.138350 May 27 03:49:31.462279 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 515/1080] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:49:31 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 28515 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:49:32.474101 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-b9d86b19-87e0-4d39-a43b-f1faa4ee2dee tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:49:32.476373 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-b9d86b19-87e0-4d39-a43b-f1faa4ee2dee tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:32.486080 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b9d86b19-87e0-4d39-a43b-f1faa4ee2dee tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:32.486744 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b9d86b19-87e0-4d39-a43b-f1faa4ee2dee tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:32.487697 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b9d86b19-87e0-4d39-a43b-f1faa4ee2dee tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:32.488514 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b9d86b19-87e0-4d39-a43b-f1faa4ee2dee tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:32.594985 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-b9d86b19-87e0-4d39-a43b-f1faa4ee2dee tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 200 len: 28515 microversion: 2.20 time: 0.124293 May 27 03:49:32.598141 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 566/1081] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:49:32 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 28515 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:49:33.013062 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-d828c9e1-c0ee-47ad-8bc1-ec29e39eb5db tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'create', calling method: .version_select at 0x7f988805d670>, body: {"keypair": {"name": "tempest-keypair-1907301300"}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:49:33.036226 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.quota [None req-d828c9e1-c0ee-47ad-8bc1-ec29e39eb5db tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Getting quotas for project 276e81e3da1f4d4c9c1881d1b1e863c4. Resources: {'key_pairs'} {{(pid=113021) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 27 03:49:33.040488 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.quota [None req-d828c9e1-c0ee-47ad-8bc1-ec29e39eb5db tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Getting quotas for user 9c1aa1f7c98f42c5a047354bef07b355 and project 276e81e3da1f4d4c9c1881d1b1e863c4. Resources: {'key_pairs'} {{(pid=113021) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 27 03:49:33.474984 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.quota [None req-d828c9e1-c0ee-47ad-8bc1-ec29e39eb5db tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Getting quotas for project 276e81e3da1f4d4c9c1881d1b1e863c4. Resources: {'key_pairs'} {{(pid=113021) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 27 03:49:33.478948 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.quota [None req-d828c9e1-c0ee-47ad-8bc1-ec29e39eb5db tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Getting quotas for user 9c1aa1f7c98f42c5a047354bef07b355 and project 276e81e3da1f4d4c9c1881d1b1e863c4. Resources: {'key_pairs'} {{(pid=113021) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 27 03:49:33.492790 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-d828c9e1-c0ee-47ad-8bc1-ec29e39eb5db tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.483763 May 27 03:49:33.493460 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 516/1082] 10.222.0.25 () {60 vars in 1158 bytes} [Thu May 27 03:49:33 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:49:33.608713 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-c24b8ac9-351d-4c1d-9bd2-095745eb772c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:49:33.609770 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-c24b8ac9-351d-4c1d-9bd2-095745eb772c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:33.617878 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c24b8ac9-351d-4c1d-9bd2-095745eb772c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:33.618327 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c24b8ac9-351d-4c1d-9bd2-095745eb772c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:33.619110 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c24b8ac9-351d-4c1d-9bd2-095745eb772c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:33.619544 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c24b8ac9-351d-4c1d-9bd2-095745eb772c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:33.719314 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-c24b8ac9-351d-4c1d-9bd2-095745eb772c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 200 len: 28683 microversion: 2.20 time: 0.115452 May 27 03:49:33.720870 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 567/1083] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:49:33 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 28683 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 27 03:49:34.732352 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-6c50b728-5f8e-49e2-b4fb-a248ac925207 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:49:34.733585 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-6c50b728-5f8e-49e2-b4fb-a248ac925207 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:34.741497 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6c50b728-5f8e-49e2-b4fb-a248ac925207 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:34.741980 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6c50b728-5f8e-49e2-b4fb-a248ac925207 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:34.742757 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6c50b728-5f8e-49e2-b4fb-a248ac925207 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:34.743198 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6c50b728-5f8e-49e2-b4fb-a248ac925207 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:34.781608 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-70d5f063-f817-4674-b6a0-3d7cde1dffec tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Action: 'create', calling method: .version_select at 0x7f98881a5040>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-482559929"}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:49:34.810706 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.quota [None req-70d5f063-f817-4674-b6a0-3d7cde1dffec tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Getting quotas for project 6b6a582a2a304a7d881efcfa2373dfb1. Resources: {'key_pairs'} {{(pid=113021) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 27 03:49:34.822419 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.quota [None req-70d5f063-f817-4674-b6a0-3d7cde1dffec tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Getting quotas for user 4fba01f5f17648a7a1fd0fbefd56e046 and project 6b6a582a2a304a7d881efcfa2373dfb1. Resources: {'key_pairs'} {{(pid=113021) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 27 03:49:34.989957 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.quota [None req-70d5f063-f817-4674-b6a0-3d7cde1dffec tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Getting quotas for project 6b6a582a2a304a7d881efcfa2373dfb1. Resources: {'key_pairs'} {{(pid=113021) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 27 03:49:34.994261 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.quota [None req-70d5f063-f817-4674-b6a0-3d7cde1dffec tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Getting quotas for user 4fba01f5f17648a7a1fd0fbefd56e046 and project 6b6a582a2a304a7d881efcfa2373dfb1. Resources: {'key_pairs'} {{(pid=113021) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 27 03:49:34.997293 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-6c50b728-5f8e-49e2-b4fb-a248ac925207 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 200 len: 28683 microversion: 2.20 time: 0.268991 May 27 03:49:34.998696 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 568/1084] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:49:34 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 28683 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:49:35.008724 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-70d5f063-f817-4674-b6a0-3d7cde1dffec tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 2314 microversion: 2.1 time: 0.416603 May 27 03:49:35.011084 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 517/1085] 10.222.0.25 () {60 vars in 1158 bytes} [Thu May 27 03:49:34 2021] POST /compute/v2.1/os-keypairs => generated 2314 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:49:36.010097 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-075c5e44-d89c-47a0-8d2f-e31b0d087995 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:49:36.011791 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-075c5e44-d89c-47a0-8d2f-e31b0d087995 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:36.019513 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-075c5e44-d89c-47a0-8d2f-e31b0d087995 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:36.019966 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-075c5e44-d89c-47a0-8d2f-e31b0d087995 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:36.020775 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-075c5e44-d89c-47a0-8d2f-e31b0d087995 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:36.021227 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-075c5e44-d89c-47a0-8d2f-e31b0d087995 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:36.131224 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-075c5e44-d89c-47a0-8d2f-e31b0d087995 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 200 len: 28683 microversion: 2.20 time: 0.124919 May 27 03:49:36.132943 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 569/1086] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:49:36 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 28683 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:49:36.411538 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-b2fbbcea-5764-4f8b-9e00-e390287fbf12 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1394963643", "imageRef": "78c0913d-0e41-4b41-b38f-f45c4f2535ff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "130ff3ea-d273-4d90-8f0d-494d41441c60"}], "security_groups": [{"name": "tempest-securitygroup--1912924276"}], "key_name": "tempest-keypair-1907301300", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:49:36.632166 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.network.neutron [None req-b2fbbcea-5764-4f8b-9e00-e390287fbf12 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] validate_networks() for [('130ff3ea-d273-4d90-8f0d-494d41441c60', None, None, None)] {{(pid=113021) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 27 03:49:37.145123 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-ee635677-8be2-4678-80e5-72802083fbec tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:49:37.147059 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-ee635677-8be2-4678-80e5-72802083fbec tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:37.155602 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ee635677-8be2-4678-80e5-72802083fbec tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:37.156368 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ee635677-8be2-4678-80e5-72802083fbec tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:37.158107 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ee635677-8be2-4678-80e5-72802083fbec tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:37.158552 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ee635677-8be2-4678-80e5-72802083fbec tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:37.273564 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-ee635677-8be2-4678-80e5-72802083fbec tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 200 len: 28683 microversion: 2.20 time: 0.132493 May 27 03:49:37.274934 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 570/1087] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:49:37 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 28683 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 27 03:49:37.307408 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.virt.hardware [None req-b2fbbcea-5764-4f8b-9e00-e390287fbf12 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Flavor limits 0:0:0 {{(pid=113021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 27 03:49:37.307780 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.virt.hardware [None req-b2fbbcea-5764-4f8b-9e00-e390287fbf12 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Image limits 0:0:0 {{(pid=113021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 27 03:49:37.308292 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.virt.hardware [None req-b2fbbcea-5764-4f8b-9e00-e390287fbf12 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Flavor pref 0:0:0 {{(pid=113021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 27 03:49:37.308739 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.virt.hardware [None req-b2fbbcea-5764-4f8b-9e00-e390287fbf12 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Image pref 0:0:0 {{(pid=113021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 27 03:49:37.309291 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.virt.hardware [None req-b2fbbcea-5764-4f8b-9e00-e390287fbf12 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=113021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 27 03:49:37.317629 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b2fbbcea-5764-4f8b-9e00-e390287fbf12 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:37.318080 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b2fbbcea-5764-4f8b-9e00-e390287fbf12 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:37.318891 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b2fbbcea-5764-4f8b-9e00-e390287fbf12 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:37.319396 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b2fbbcea-5764-4f8b-9e00-e390287fbf12 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:37.336746 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.quota [None req-b2fbbcea-5764-4f8b-9e00-e390287fbf12 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Getting quotas for project 276e81e3da1f4d4c9c1881d1b1e863c4. Resources: {'instances', 'cores', 'ram'} {{(pid=113021) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 27 03:49:37.342598 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.quota [None req-b2fbbcea-5764-4f8b-9e00-e390287fbf12 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Getting quotas for user 9c1aa1f7c98f42c5a047354bef07b355 and project 276e81e3da1f4d4c9c1881d1b1e863c4. Resources: {'instances', 'cores', 'ram'} {{(pid=113021) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 27 03:49:37.356614 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-b2fbbcea-5764-4f8b-9e00-e390287fbf12 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Going to run 1 instances... {{(pid=113021) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 27 03:49:37.362938 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-b2fbbcea-5764-4f8b-9e00-e390287fbf12 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78c0913d-0e41-4b41-b38f-f45c4f2535ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=113021) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 27 03:49:37.549363 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-b2fbbcea-5764-4f8b-9e00-e390287fbf12 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.140504 May 27 03:49:37.552445 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 518/1088] 10.222.0.25 () {60 vars in 1147 bytes} [Thu May 27 03:49:36 2021] POST /compute/v2.1/servers => generated 402 bytes in 1145 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 03:49:37.562758 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-75105c2a-3389-49c8-bc68-1aa8ef6bd1ce tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:49:37.563551 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-75105c2a-3389-49c8-bc68-1aa8ef6bd1ce tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:37.674039 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-75105c2a-3389-49c8-bc68-1aa8ef6bd1ce tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:49:37.681987 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-75105c2a-3389-49c8-bc68-1aa8ef6bd1ce tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962" status: 200 len: 1238 microversion: 2.1 time: 0.124369 May 27 03:49:37.682573 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 571/1089] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:49:37 2021] GET /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962 => generated 1238 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:49:38.286658 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-c187c366-0cc7-4375-a97c-b71ab9aa97f1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:49:38.287649 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-c187c366-0cc7-4375-a97c-b71ab9aa97f1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:38.295668 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c187c366-0cc7-4375-a97c-b71ab9aa97f1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:38.296119 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c187c366-0cc7-4375-a97c-b71ab9aa97f1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:38.296936 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c187c366-0cc7-4375-a97c-b71ab9aa97f1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:38.300680 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c187c366-0cc7-4375-a97c-b71ab9aa97f1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:38.390773 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-c187c366-0cc7-4375-a97c-b71ab9aa97f1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 200 len: 28683 microversion: 2.20 time: 0.107690 May 27 03:49:38.391346 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 519/1090] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:49:38 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 28683 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:49:38.698790 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-5a82dd92-4b32-4d6f-813a-97f380d1cb4d tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:49:38.699305 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-5a82dd92-4b32-4d6f-813a-97f380d1cb4d tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:38.708909 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-5a82dd92-4b32-4d6f-813a-97f380d1cb4d tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:38.709386 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-5a82dd92-4b32-4d6f-813a-97f380d1cb4d tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:38.710136 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-5a82dd92-4b32-4d6f-813a-97f380d1cb4d tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:38.710575 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-5a82dd92-4b32-4d6f-813a-97f380d1cb4d tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:38.822873 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-5a82dd92-4b32-4d6f-813a-97f380d1cb4d tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:49:38.831202 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-5a82dd92-4b32-4d6f-813a-97f380d1cb4d tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962" status: 200 len: 1242 microversion: 2.1 time: 0.136229 May 27 03:49:38.831762 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 572/1091] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:49:38 2021] GET /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962 => generated 1242 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:49:39.403749 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-cf7b9ba3-efaf-4848-8244-9db89eb6beba tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:49:39.404864 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-cf7b9ba3-efaf-4848-8244-9db89eb6beba tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:39.413109 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-cf7b9ba3-efaf-4848-8244-9db89eb6beba tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:39.413566 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-cf7b9ba3-efaf-4848-8244-9db89eb6beba tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:39.414343 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-cf7b9ba3-efaf-4848-8244-9db89eb6beba tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:39.414784 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-cf7b9ba3-efaf-4848-8244-9db89eb6beba tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:39.513429 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-cf7b9ba3-efaf-4848-8244-9db89eb6beba tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 200 len: 28683 microversion: 2.20 time: 0.113564 May 27 03:49:39.514167 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 520/1092] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:49:39 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 28683 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:49:39.849122 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-7999e877-0adf-4266-8802-51b598085871 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:49:39.849746 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-7999e877-0adf-4266-8802-51b598085871 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:39.862502 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7999e877-0adf-4266-8802-51b598085871 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:39.863363 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7999e877-0adf-4266-8802-51b598085871 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:39.864251 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7999e877-0adf-4266-8802-51b598085871 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:39.864759 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7999e877-0adf-4266-8802-51b598085871 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:39.998300 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-7999e877-0adf-4266-8802-51b598085871 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:49:40.010556 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-7999e877-0adf-4266-8802-51b598085871 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962" status: 200 len: 1298 microversion: 2.1 time: 0.165782 May 27 03:49:40.011590 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 573/1093] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:49:39 2021] GET /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962 => generated 1298 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:49:40.525859 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-e6ecb4d2-3932-4858-a7a5-da4e39be1f75 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:49:40.526952 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-e6ecb4d2-3932-4858-a7a5-da4e39be1f75 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:40.535079 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e6ecb4d2-3932-4858-a7a5-da4e39be1f75 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:40.535580 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e6ecb4d2-3932-4858-a7a5-da4e39be1f75 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:40.536356 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e6ecb4d2-3932-4858-a7a5-da4e39be1f75 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:40.536828 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e6ecb4d2-3932-4858-a7a5-da4e39be1f75 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:40.647964 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-e6ecb4d2-3932-4858-a7a5-da4e39be1f75 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 200 len: 28683 microversion: 2.20 time: 0.126137 May 27 03:49:40.649185 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 521/1094] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:49:40 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 28683 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:49:41.028787 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-9500145d-4183-4dd8-a49c-0ce521da5dfc tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:49:41.029377 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-9500145d-4183-4dd8-a49c-0ce521da5dfc tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:41.041611 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9500145d-4183-4dd8-a49c-0ce521da5dfc tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:41.041979 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9500145d-4183-4dd8-a49c-0ce521da5dfc tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:41.042809 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9500145d-4183-4dd8-a49c-0ce521da5dfc tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:41.043243 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9500145d-4183-4dd8-a49c-0ce521da5dfc tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:41.280111 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-9500145d-4183-4dd8-a49c-0ce521da5dfc tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:49:41.289439 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-9500145d-4183-4dd8-a49c-0ce521da5dfc tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962" status: 200 len: 1364 microversion: 2.1 time: 0.266063 May 27 03:49:41.290017 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 574/1095] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:49:41 2021] GET /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962 => generated 1364 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:49:41.669141 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-472cc96f-5c8b-4509-a200-a29f62a63e3f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:49:41.671814 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-472cc96f-5c8b-4509-a200-a29f62a63e3f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:41.686460 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-472cc96f-5c8b-4509-a200-a29f62a63e3f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:41.687070 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-472cc96f-5c8b-4509-a200-a29f62a63e3f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:41.688004 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-472cc96f-5c8b-4509-a200-a29f62a63e3f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:41.688957 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-472cc96f-5c8b-4509-a200-a29f62a63e3f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:41.796030 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-472cc96f-5c8b-4509-a200-a29f62a63e3f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 200 len: 28683 microversion: 2.20 time: 0.138752 May 27 03:49:41.797349 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 522/1096] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:49:41 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 28683 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:49:41.913085 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-7adb18c1-2244-4f88-be35-2fc84195efa0 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-81960653"}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:49:41.913637 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-7adb18c1-2244-4f88-be35-2fc84195efa0 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] [instance: daffe717-7636-45e8-813d-8b2a6075c61e] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:41.921388 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7adb18c1-2244-4f88-be35-2fc84195efa0 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:41.921842 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7adb18c1-2244-4f88-be35-2fc84195efa0 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:41.922612 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7adb18c1-2244-4f88-be35-2fc84195efa0 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:41.923054 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7adb18c1-2244-4f88-be35-2fc84195efa0 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:42.086437 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [req-b6a6ae1f-2e42-4308-aa13-b8215a84469f req-3fc25a72-f83e-4a5f-972f-c3bc49c4741f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962", "tag": "9d0a9265-835b-4677-b698-b6832076290d"}]} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:49:42.088471 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:49:42.088471 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: warnings.warn(msg) May 27 03:49:42.097988 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-b6a6ae1f-2e42-4308-aa13-b8215a84469f req-3fc25a72-f83e-4a5f-972f-c3bc49c4741f service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:42.098482 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-b6a6ae1f-2e42-4308-aa13-b8215a84469f req-3fc25a72-f83e-4a5f-972f-c3bc49c4741f service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:42.121161 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.compute.server_external_events [req-b6a6ae1f-2e42-4308-aa13-b8215a84469f req-3fc25a72-f83e-4a5f-972f-c3bc49c4741f service nova] Creating event network-changed:9d0a9265-835b-4677-b698-b6832076290d for instance 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962 on hv-cinder-79326 May 27 03:49:42.126470 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [req-b6a6ae1f-2e42-4308-aa13-b8215a84469f req-3fc25a72-f83e-4a5f-972f-c3bc49c4741f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044545 May 27 03:49:42.127321 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 523/1097] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:49:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:49:42.137031 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.network.security_group_api [None req-7adb18c1-2244-4f88-be35-2fc84195efa0 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Removing security group ddcda7fa-20c2-4652-a278-ed29013fdd44 from port 2beacebc-a476-4d0c-ad0f-528ef5b957c8 May 27 03:49:42.308385 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-8b985f4c-ed20-43b2-aaaa-f4918ef95b85 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:49:42.309681 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-8b985f4c-ed20-43b2-aaaa-f4918ef95b85 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:42.326691 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8b985f4c-ed20-43b2-aaaa-f4918ef95b85 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:42.328890 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8b985f4c-ed20-43b2-aaaa-f4918ef95b85 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:42.334985 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8b985f4c-ed20-43b2-aaaa-f4918ef95b85 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:42.336870 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8b985f4c-ed20-43b2-aaaa-f4918ef95b85 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:42.744107 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-8b985f4c-ed20-43b2-aaaa-f4918ef95b85 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:49:42.753276 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-8b985f4c-ed20-43b2-aaaa-f4918ef95b85 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962" status: 200 len: 1364 microversion: 2.1 time: 0.449373 May 27 03:49:42.754072 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 524/1098] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:49:42 2021] GET /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962 => generated 1364 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:49:42.810091 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-73459b3c-f602-472e-a604-5e2b59351618 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:49:42.811197 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-73459b3c-f602-472e-a604-5e2b59351618 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:42.837717 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-7adb18c1-2244-4f88-be35-2fc84195efa0 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] 10.222.0.25 "POST /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e/action" status: 202 len: 0 microversion: 2.1 time: 1.050973 May 27 03:49:42.839061 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 575/1099] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:49:41 2021] POST /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e/action => generated 0 bytes in 1053 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 27 03:49:42.840799 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-73459b3c-f602-472e-a604-5e2b59351618 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:42.841281 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-73459b3c-f602-472e-a604-5e2b59351618 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:42.842273 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-73459b3c-f602-472e-a604-5e2b59351618 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:42.847287 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-73459b3c-f602-472e-a604-5e2b59351618 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:42.848500 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [req-f0393f47-1457-43c3-b44b-3dc217dd283f req-90a57ee2-7d74-45ff-85de-64c777184db3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "daffe717-7636-45e8-813d-8b2a6075c61e", "tag": "2beacebc-a476-4d0c-ad0f-528ef5b957c8"}]} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:49:42.850253 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:49:42.850253 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: warnings.warn(msg) May 27 03:49:42.870765 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-f0393f47-1457-43c3-b44b-3dc217dd283f req-90a57ee2-7d74-45ff-85de-64c777184db3 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:42.871330 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-f0393f47-1457-43c3-b44b-3dc217dd283f req-90a57ee2-7d74-45ff-85de-64c777184db3 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:42.891454 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.compute.server_external_events [req-f0393f47-1457-43c3-b44b-3dc217dd283f req-90a57ee2-7d74-45ff-85de-64c777184db3 service nova] Creating event network-changed:2beacebc-a476-4d0c-ad0f-528ef5b957c8 for instance daffe717-7636-45e8-813d-8b2a6075c61e on hv-cinder-79326 May 27 03:49:42.899682 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [req-f0393f47-1457-43c3-b44b-3dc217dd283f req-90a57ee2-7d74-45ff-85de-64c777184db3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054928 May 27 03:49:42.900746 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 576/1100] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:49:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:49:42.973253 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-73459b3c-f602-472e-a604-5e2b59351618 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 200 len: 28683 microversion: 2.20 time: 0.168856 May 27 03:49:42.974737 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 525/1101] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:49:42 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 28683 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 27 03:49:43.773946 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-2b4655ec-ac23-4679-804f-9f796c99b922 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:49:43.774663 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-2b4655ec-ac23-4679-804f-9f796c99b922 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:43.782905 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-2b4655ec-ac23-4679-804f-9f796c99b922 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:43.783431 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-2b4655ec-ac23-4679-804f-9f796c99b922 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:43.784277 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-2b4655ec-ac23-4679-804f-9f796c99b922 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:43.784836 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-2b4655ec-ac23-4679-804f-9f796c99b922 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:43.986346 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-2011e725-dd99-4f65-a352-90af840973e9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:49:43.987613 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-2011e725-dd99-4f65-a352-90af840973e9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:43.995406 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2011e725-dd99-4f65-a352-90af840973e9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:43.996021 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2011e725-dd99-4f65-a352-90af840973e9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:43.996926 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2011e725-dd99-4f65-a352-90af840973e9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:43.997559 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2011e725-dd99-4f65-a352-90af840973e9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:44.165029 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-2b4655ec-ac23-4679-804f-9f796c99b922 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:49:44.173644 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-2b4655ec-ac23-4679-804f-9f796c99b922 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962" status: 200 len: 1364 microversion: 2.1 time: 0.404897 May 27 03:49:44.180453 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 577/1102] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:49:43 2021] GET /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962 => generated 1364 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:49:44.266838 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-2011e725-dd99-4f65-a352-90af840973e9 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 200 len: 28683 microversion: 2.20 time: 0.284525 May 27 03:49:44.270758 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 526/1103] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:49:43 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 28683 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:49:45.190258 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-16f24567-8655-4e0b-8e8d-bff3d77c37bf tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:49:45.190811 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-16f24567-8655-4e0b-8e8d-bff3d77c37bf tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:45.198556 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-16f24567-8655-4e0b-8e8d-bff3d77c37bf tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:45.199242 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-16f24567-8655-4e0b-8e8d-bff3d77c37bf tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:45.200244 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-16f24567-8655-4e0b-8e8d-bff3d77c37bf tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:45.200725 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-16f24567-8655-4e0b-8e8d-bff3d77c37bf tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:45.279639 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-4a760422-17d1-4105-b945-11b14ac677d3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:49:45.280712 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-4a760422-17d1-4105-b945-11b14ac677d3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:45.289382 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-4a760422-17d1-4105-b945-11b14ac677d3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:45.289847 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-4a760422-17d1-4105-b945-11b14ac677d3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:45.290648 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-4a760422-17d1-4105-b945-11b14ac677d3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:45.291082 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-4a760422-17d1-4105-b945-11b14ac677d3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:45.387332 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-4a760422-17d1-4105-b945-11b14ac677d3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 200 len: 28683 microversion: 2.20 time: 0.111541 May 27 03:49:45.391261 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 527/1104] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:49:45 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 28683 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 27 03:49:45.613427 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-16f24567-8655-4e0b-8e8d-bff3d77c37bf tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:49:45.622303 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-16f24567-8655-4e0b-8e8d-bff3d77c37bf tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962" status: 200 len: 1364 microversion: 2.1 time: 0.435745 May 27 03:49:45.623236 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 578/1105] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:49:45 2021] GET /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962 => generated 1364 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:49:45.642251 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-ebb3ce37-4ad0-4ef2-849c-a9d761834c02 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:49:45.649567 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-ebb3ce37-4ad0-4ef2-849c-a9d761834c02 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] [instance: daffe717-7636-45e8-813d-8b2a6075c61e] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:45.649698 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [req-520c6ac1-7c52-4de3-8efd-3992817fae67 req-e0851d13-a575-4264-bdf2-676c45385f05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "daffe717-7636-45e8-813d-8b2a6075c61e", "tag": "2beacebc-a476-4d0c-ad0f-528ef5b957c8"}]} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:49:45.650876 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:49:45.650876 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: warnings.warn(msg) May 27 03:49:45.651972 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ebb3ce37-4ad0-4ef2-849c-a9d761834c02 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:45.652576 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ebb3ce37-4ad0-4ef2-849c-a9d761834c02 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:45.653595 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ebb3ce37-4ad0-4ef2-849c-a9d761834c02 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:45.654097 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ebb3ce37-4ad0-4ef2-849c-a9d761834c02 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:45.658552 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-520c6ac1-7c52-4de3-8efd-3992817fae67 req-e0851d13-a575-4264-bdf2-676c45385f05 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:45.658996 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-520c6ac1-7c52-4de3-8efd-3992817fae67 req-e0851d13-a575-4264-bdf2-676c45385f05 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:45.674946 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.compute.server_external_events [req-520c6ac1-7c52-4de3-8efd-3992817fae67 req-e0851d13-a575-4264-bdf2-676c45385f05 service nova] Creating event network-changed:2beacebc-a476-4d0c-ad0f-528ef5b957c8 for instance daffe717-7636-45e8-813d-8b2a6075c61e on hv-cinder-79326 May 27 03:49:45.680200 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [req-520c6ac1-7c52-4de3-8efd-3992817fae67 req-e0851d13-a575-4264-bdf2-676c45385f05 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035113 May 27 03:49:45.680821 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 579/1106] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:49:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:49:45.837508 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.objects.instance [None req-ebb3ce37-4ad0-4ef2-849c-a9d761834c02 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lazy-loading 'services' on Instance uuid daffe717-7636-45e8-813d-8b2a6075c61e {{(pid=113021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 27 03:49:46.130384 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-ebb3ce37-4ad0-4ef2-849c-a9d761834c02 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] 10.222.0.25 "DELETE /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e/os-volume_attachments/716cd419-03d5-45e0-90da-4d9ec3b118a3" status: 202 len: 0 microversion: 2.1 time: 0.497615 May 27 03:49:46.135266 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 528/1107] 10.222.0.25 () {58 vars in 1416 bytes} [Thu May 27 03:49:45 2021] DELETE /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e/os-volume_attachments/716cd419-03d5-45e0-90da-4d9ec3b118a3 => generated 0 bytes in 503 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:49:46.141456 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-6f937f5b-03f5-4282-a200-0cf70e3b5fed tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:49:46.142732 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-6f937f5b-03f5-4282-a200-0cf70e3b5fed tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] [instance: daffe717-7636-45e8-813d-8b2a6075c61e] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:46.151980 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6f937f5b-03f5-4282-a200-0cf70e3b5fed tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:46.152930 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6f937f5b-03f5-4282-a200-0cf70e3b5fed tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:46.154377 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6f937f5b-03f5-4282-a200-0cf70e3b5fed tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:46.155269 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6f937f5b-03f5-4282-a200-0cf70e3b5fed tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:46.227747 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-6f937f5b-03f5-4282-a200-0cf70e3b5fed tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] 10.222.0.25 "GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090422 May 27 03:49:46.234050 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 580/1108] 10.222.0.25 () {58 vars in 1302 bytes} [Thu May 27 03:49:46 2021] GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:49:46.400663 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-5518d1bc-c3fb-45a1-9f8b-534ddfd4e4ff tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:49:46.401683 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-5518d1bc-c3fb-45a1-9f8b-534ddfd4e4ff tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:46.409693 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-5518d1bc-c3fb-45a1-9f8b-534ddfd4e4ff tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:46.410145 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-5518d1bc-c3fb-45a1-9f8b-534ddfd4e4ff tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:46.411108 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-5518d1bc-c3fb-45a1-9f8b-534ddfd4e4ff tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:46.411559 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-5518d1bc-c3fb-45a1-9f8b-534ddfd4e4ff tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:46.541124 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-5518d1bc-c3fb-45a1-9f8b-534ddfd4e4ff tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 200 len: 28683 microversion: 2.20 time: 0.145270 May 27 03:49:46.545042 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 529/1109] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:49:46 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 28683 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:49:46.640935 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-fa1f6455-1b60-4cc7-9610-a16698357913 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:49:46.640935 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-fa1f6455-1b60-4cc7-9610-a16698357913 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:46.652294 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-fa1f6455-1b60-4cc7-9610-a16698357913 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:46.652995 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-fa1f6455-1b60-4cc7-9610-a16698357913 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:46.653872 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-fa1f6455-1b60-4cc7-9610-a16698357913 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:46.654311 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-fa1f6455-1b60-4cc7-9610-a16698357913 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:46.860946 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-fa1f6455-1b60-4cc7-9610-a16698357913 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:49:46.869560 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-fa1f6455-1b60-4cc7-9610-a16698357913 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962" status: 200 len: 1364 microversion: 2.1 time: 0.234267 May 27 03:49:46.870140 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 581/1110] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:49:46 2021] GET /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962 => generated 1364 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:49:47.240832 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-624e6481-3352-40fd-a05c-df2dcf146432 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:49:47.242396 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-624e6481-3352-40fd-a05c-df2dcf146432 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] [instance: daffe717-7636-45e8-813d-8b2a6075c61e] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:47.250211 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-624e6481-3352-40fd-a05c-df2dcf146432 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:47.250666 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-624e6481-3352-40fd-a05c-df2dcf146432 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:47.251437 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-624e6481-3352-40fd-a05c-df2dcf146432 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:47.251878 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-624e6481-3352-40fd-a05c-df2dcf146432 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:47.316358 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-624e6481-3352-40fd-a05c-df2dcf146432 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] 10.222.0.25 "GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079647 May 27 03:49:47.316860 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 530/1111] 10.222.0.25 () {58 vars in 1302 bytes} [Thu May 27 03:49:47 2021] GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:49:47.552849 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-fb70563c-7bd1-419d-b88c-be7a1a1a5358 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:49:47.553775 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-fb70563c-7bd1-419d-b88c-be7a1a1a5358 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:47.562180 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-fb70563c-7bd1-419d-b88c-be7a1a1a5358 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:47.562629 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-fb70563c-7bd1-419d-b88c-be7a1a1a5358 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:47.563411 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-fb70563c-7bd1-419d-b88c-be7a1a1a5358 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:47.563850 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-fb70563c-7bd1-419d-b88c-be7a1a1a5358 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:47.683050 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-fb70563c-7bd1-419d-b88c-be7a1a1a5358 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 200 len: 28683 microversion: 2.20 time: 0.133719 May 27 03:49:47.686853 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 582/1112] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:49:47 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 28683 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 27 03:49:47.886473 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-1b70fccc-5597-4918-afa0-720e1b3a98d5 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:49:47.887099 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-1b70fccc-5597-4918-afa0-720e1b3a98d5 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:47.894849 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1b70fccc-5597-4918-afa0-720e1b3a98d5 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:47.895307 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1b70fccc-5597-4918-afa0-720e1b3a98d5 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:47.896095 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1b70fccc-5597-4918-afa0-720e1b3a98d5 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:47.896576 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1b70fccc-5597-4918-afa0-720e1b3a98d5 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:48.095746 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-1b70fccc-5597-4918-afa0-720e1b3a98d5 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:49:48.104475 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-1b70fccc-5597-4918-afa0-720e1b3a98d5 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962" status: 200 len: 1364 microversion: 2.1 time: 0.222111 May 27 03:49:48.105033 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 531/1113] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:49:47 2021] GET /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962 => generated 1364 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:49:48.329118 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-aca1e73c-b66c-48ef-95b0-27f9a9793de5 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:49:48.330047 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-aca1e73c-b66c-48ef-95b0-27f9a9793de5 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] [instance: daffe717-7636-45e8-813d-8b2a6075c61e] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:48.338634 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-aca1e73c-b66c-48ef-95b0-27f9a9793de5 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:48.339162 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-aca1e73c-b66c-48ef-95b0-27f9a9793de5 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:48.339920 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-aca1e73c-b66c-48ef-95b0-27f9a9793de5 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:48.340359 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-aca1e73c-b66c-48ef-95b0-27f9a9793de5 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:48.406478 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-aca1e73c-b66c-48ef-95b0-27f9a9793de5 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] 10.222.0.25 "GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.081954 May 27 03:49:48.407292 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 583/1114] 10.222.0.25 () {58 vars in 1302 bytes} [Thu May 27 03:49:48 2021] GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e/os-volume_attachments => generated 25 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 03:49:48.417131 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-baffd1c7-f95d-4abb-91d9-e7eeb20c0c60 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:49:48.424755 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-baffd1c7-f95d-4abb-91d9-e7eeb20c0c60 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] [instance: daffe717-7636-45e8-813d-8b2a6075c61e] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:48.425888 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-baffd1c7-f95d-4abb-91d9-e7eeb20c0c60 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:48.426469 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-baffd1c7-f95d-4abb-91d9-e7eeb20c0c60 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:48.427309 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-baffd1c7-f95d-4abb-91d9-e7eeb20c0c60 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:48.427744 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-baffd1c7-f95d-4abb-91d9-e7eeb20c0c60 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:48.586532 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.wsgi [None req-baffd1c7-f95d-4abb-91d9-e7eeb20c0c60 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] HTTP exception thrown: Instance daffe717-7636-45e8-813d-8b2a6075c61e is not attached to volume 716cd419-03d5-45e0-90da-4d9ec3b118a3 May 27 03:49:48.587069 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-baffd1c7-f95d-4abb-91d9-e7eeb20c0c60 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Returning 404 to user: Instance daffe717-7636-45e8-813d-8b2a6075c61e is not attached to volume 716cd419-03d5-45e0-90da-4d9ec3b118a3 {{(pid=113021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 27 03:49:48.587901 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-baffd1c7-f95d-4abb-91d9-e7eeb20c0c60 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] 10.222.0.25 "DELETE /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e/os-volume_attachments/716cd419-03d5-45e0-90da-4d9ec3b118a3" status: 404 len: 154 microversion: 2.1 time: 0.174635 May 27 03:49:48.588464 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 532/1115] 10.222.0.25 () {58 vars in 1416 bytes} [Thu May 27 03:49:48 2021] DELETE /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e/os-volume_attachments/716cd419-03d5-45e0-90da-4d9ec3b118a3 => generated 154 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:49:48.694782 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-09c96d30-2428-4045-a880-4f0034d2fcd1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:49:48.696255 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-09c96d30-2428-4045-a880-4f0034d2fcd1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:48.703618 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-09c96d30-2428-4045-a880-4f0034d2fcd1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:48.709738 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-09c96d30-2428-4045-a880-4f0034d2fcd1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:48.709738 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-09c96d30-2428-4045-a880-4f0034d2fcd1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:48.709738 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-09c96d30-2428-4045-a880-4f0034d2fcd1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:48.815121 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-09c96d30-2428-4045-a880-4f0034d2fcd1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 200 len: 28683 microversion: 2.20 time: 0.123941 May 27 03:49:48.816767 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 584/1116] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:49:48 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 28683 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:49:49.121830 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-452cdfab-dba9-4891-bfad-c166cc5e6e88 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:49:49.122480 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-452cdfab-dba9-4891-bfad-c166cc5e6e88 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:49.129954 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-452cdfab-dba9-4891-bfad-c166cc5e6e88 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:49.130624 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-452cdfab-dba9-4891-bfad-c166cc5e6e88 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:49.131459 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-452cdfab-dba9-4891-bfad-c166cc5e6e88 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:49.131897 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-452cdfab-dba9-4891-bfad-c166cc5e6e88 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:49.297461 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [req-0dd66c22-d27b-4367-9fbb-097c099e6c84 req-735de862-663f-41df-acb8-1ec8f5568aec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962", "name": "network-vif-plugged", "status": "completed", "tag": "9d0a9265-835b-4677-b698-b6832076290d"}]} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:49:49.299125 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:49:49.299125 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: warnings.warn(msg) May 27 03:49:49.308346 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-0dd66c22-d27b-4367-9fbb-097c099e6c84 req-735de862-663f-41df-acb8-1ec8f5568aec service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:49.308830 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-0dd66c22-d27b-4367-9fbb-097c099e6c84 req-735de862-663f-41df-acb8-1ec8f5568aec service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:49.325019 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.compute.server_external_events [req-0dd66c22-d27b-4367-9fbb-097c099e6c84 req-735de862-663f-41df-acb8-1ec8f5568aec service nova] Creating event network-vif-plugged:9d0a9265-835b-4677-b698-b6832076290d for instance 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962 on hv-cinder-79326 May 27 03:49:49.329929 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [req-0dd66c22-d27b-4367-9fbb-097c099e6c84 req-735de862-663f-41df-acb8-1ec8f5568aec service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036608 May 27 03:49:49.330819 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 585/1117] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:49:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:49:49.332450 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-452cdfab-dba9-4891-bfad-c166cc5e6e88 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:49:49.340868 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-452cdfab-dba9-4891-bfad-c166cc5e6e88 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962" status: 200 len: 1364 microversion: 2.1 time: 0.222709 May 27 03:49:49.341422 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 533/1118] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:49:49 2021] GET /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962 => generated 1364 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:49:49.827624 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-6d8e0054-6a5f-4b73-a41e-720e52ff42b3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:49:49.828661 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-6d8e0054-6a5f-4b73-a41e-720e52ff42b3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:49.836744 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6d8e0054-6a5f-4b73-a41e-720e52ff42b3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:49.837193 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6d8e0054-6a5f-4b73-a41e-720e52ff42b3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:49.837951 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6d8e0054-6a5f-4b73-a41e-720e52ff42b3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:49.838381 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6d8e0054-6a5f-4b73-a41e-720e52ff42b3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:49.987236 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-a9fdd833-e9ff-43f0-bcfe-bf51e1706b82 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:49:49.987742 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-a9fdd833-e9ff-43f0-bcfe-bf51e1706b82 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] [instance: daffe717-7636-45e8-813d-8b2a6075c61e] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:49.995035 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a9fdd833-e9ff-43f0-bcfe-bf51e1706b82 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:49.995492 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a9fdd833-e9ff-43f0-bcfe-bf51e1706b82 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:49.996264 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a9fdd833-e9ff-43f0-bcfe-bf51e1706b82 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:49.996891 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a9fdd833-e9ff-43f0-bcfe-bf51e1706b82 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:50.018308 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-6d8e0054-6a5f-4b73-a41e-720e52ff42b3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 200 len: 28683 microversion: 2.20 time: 0.194578 May 27 03:49:50.019130 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 586/1119] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:49:49 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 28683 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:49:50.060894 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-a9fdd833-e9ff-43f0-bcfe-bf51e1706b82 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] [instance: daffe717-7636-45e8-813d-8b2a6075c61e] Going to try to terminate instance {{(pid=113021) delete /opt/stack/nova/nova/compute/api.py:2539}} May 27 03:49:50.358692 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-ae1db5ce-4ab8-4c97-beb8-ce040c22761f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:49:50.359308 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-ae1db5ce-4ab8-4c97-beb8-ce040c22761f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:50.367621 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ae1db5ce-4ab8-4c97-beb8-ce040c22761f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:50.368071 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ae1db5ce-4ab8-4c97-beb8-ce040c22761f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:50.368865 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ae1db5ce-4ab8-4c97-beb8-ce040c22761f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:50.369303 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ae1db5ce-4ab8-4c97-beb8-ce040c22761f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:50.377875 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-a9fdd833-e9ff-43f0-bcfe-bf51e1706b82 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] 10.222.0.25 "DELETE /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e" status: 204 len: 0 microversion: 2.1 time: 0.394293 May 27 03:49:50.378858 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 534/1120] 10.222.0.25 () {58 vars in 1239 bytes} [Thu May 27 03:49:49 2021] DELETE /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 27 03:49:50.387602 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-b0854b2d-e428-4b74-8833-5662a7b6b2d5 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:49:50.388331 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-b0854b2d-e428-4b74-8833-5662a7b6b2d5 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] [instance: daffe717-7636-45e8-813d-8b2a6075c61e] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:50.395977 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b0854b2d-e428-4b74-8833-5662a7b6b2d5 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:50.396462 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b0854b2d-e428-4b74-8833-5662a7b6b2d5 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:50.397329 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b0854b2d-e428-4b74-8833-5662a7b6b2d5 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:50.397804 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b0854b2d-e428-4b74-8833-5662a7b6b2d5 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:50.586079 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-ae1db5ce-4ab8-4c97-beb8-ce040c22761f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:49:50.595111 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-ae1db5ce-4ab8-4c97-beb8-ce040c22761f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962" status: 200 len: 1364 microversion: 2.1 time: 0.240611 May 27 03:49:50.595692 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 587/1121] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:49:50 2021] GET /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962 => generated 1364 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:49:50.697615 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-b0854b2d-e428-4b74-8833-5662a7b6b2d5 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf67cc7398a4e1cb6f565ebe2241e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df96baa86bb4c51b3b8bece28e3e23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:49:50.706389 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-b0854b2d-e428-4b74-8833-5662a7b6b2d5 tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] 10.222.0.25 "GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e" status: 200 len: 1553 microversion: 2.1 time: 0.322681 May 27 03:49:50.706945 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 535/1122] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:49:50 2021] GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e => generated 1553 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:49:51.029824 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-dfc3ff5d-1d16-44d3-a004-aca54f25e319 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:49:51.031346 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-dfc3ff5d-1d16-44d3-a004-aca54f25e319 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:51.039661 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-dfc3ff5d-1d16-44d3-a004-aca54f25e319 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:51.047607 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-dfc3ff5d-1d16-44d3-a004-aca54f25e319 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:51.047607 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-dfc3ff5d-1d16-44d3-a004-aca54f25e319 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:51.047607 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-dfc3ff5d-1d16-44d3-a004-aca54f25e319 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:51.141802 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-dfc3ff5d-1d16-44d3-a004-aca54f25e319 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 200 len: 28683 microversion: 2.20 time: 0.115343 May 27 03:49:51.146057 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 588/1123] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:49:51 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 28683 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:49:51.612125 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-108a2cc6-9977-4d89-bd79-9c0a215e2236 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:49:51.612761 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-108a2cc6-9977-4d89-bd79-9c0a215e2236 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:51.619990 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-108a2cc6-9977-4d89-bd79-9c0a215e2236 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:51.620472 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-108a2cc6-9977-4d89-bd79-9c0a215e2236 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:51.621234 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-108a2cc6-9977-4d89-bd79-9c0a215e2236 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:51.621668 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-108a2cc6-9977-4d89-bd79-9c0a215e2236 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:51.723749 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-1e3a3f1b-73ea-4f11-9817-fd360c687c4d tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:49:51.724358 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-1e3a3f1b-73ea-4f11-9817-fd360c687c4d tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] [instance: daffe717-7636-45e8-813d-8b2a6075c61e] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:51.732754 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1e3a3f1b-73ea-4f11-9817-fd360c687c4d tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:51.733204 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1e3a3f1b-73ea-4f11-9817-fd360c687c4d tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:51.733980 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1e3a3f1b-73ea-4f11-9817-fd360c687c4d tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:51.734426 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1e3a3f1b-73ea-4f11-9817-fd360c687c4d tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:51.832863 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-108a2cc6-9977-4d89-bd79-9c0a215e2236 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:49:51.841336 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-108a2cc6-9977-4d89-bd79-9c0a215e2236 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962" status: 200 len: 1550 microversion: 2.1 time: 0.232812 May 27 03:49:51.841903 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 536/1124] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:49:51 2021] GET /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962 => generated 1550 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:49:51.857469 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-e4a6da5f-46e1-484f-93e5-4828a8ca1e9c tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:49:51.858085 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-e4a6da5f-46e1-484f-93e5-4828a8ca1e9c tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:51.865576 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e4a6da5f-46e1-484f-93e5-4828a8ca1e9c tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:51.866040 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e4a6da5f-46e1-484f-93e5-4828a8ca1e9c tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:51.867305 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e4a6da5f-46e1-484f-93e5-4828a8ca1e9c tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:51.867754 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e4a6da5f-46e1-484f-93e5-4828a8ca1e9c tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:52.016273 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-e4a6da5f-46e1-484f-93e5-4828a8ca1e9c tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.162446 May 27 03:49:52.016995 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 537/1125] 10.222.0.25 () {58 vars in 1275 bytes} [Thu May 27 03:49:51 2021] GET /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/os-interface => generated 285 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:49:52.042605 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-1e3a3f1b-73ea-4f11-9817-fd360c687c4d tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf67cc7398a4e1cb6f565ebe2241e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df96baa86bb4c51b3b8bece28e3e23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:49:52.051439 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-1e3a3f1b-73ea-4f11-9817-fd360c687c4d tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] 10.222.0.25 "GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e" status: 200 len: 1553 microversion: 2.1 time: 0.331865 May 27 03:49:52.052015 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 589/1126] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:49:51 2021] GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e => generated 1553 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:49:52.155085 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-8f5b9663-c6f5-411b-8205-e420c5089f86 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:49:52.156376 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-8f5b9663-c6f5-411b-8205-e420c5089f86 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:52.164112 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8f5b9663-c6f5-411b-8205-e420c5089f86 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:52.164703 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8f5b9663-c6f5-411b-8205-e420c5089f86 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:52.165770 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8f5b9663-c6f5-411b-8205-e420c5089f86 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:52.166322 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8f5b9663-c6f5-411b-8205-e420c5089f86 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:52.348435 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-8f5b9663-c6f5-411b-8205-e420c5089f86 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 200 len: 28683 microversion: 2.20 time: 0.196862 May 27 03:49:52.352364 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 538/1127] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:49:52 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 28683 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 27 03:49:53.068603 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-cb1e3a33-747e-464f-95d3-dc9ca447fa0f tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:49:53.069222 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-cb1e3a33-747e-464f-95d3-dc9ca447fa0f tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] [instance: daffe717-7636-45e8-813d-8b2a6075c61e] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:53.076982 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-cb1e3a33-747e-464f-95d3-dc9ca447fa0f tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:53.077444 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-cb1e3a33-747e-464f-95d3-dc9ca447fa0f tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:53.078225 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-cb1e3a33-747e-464f-95d3-dc9ca447fa0f tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:53.078662 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-cb1e3a33-747e-464f-95d3-dc9ca447fa0f tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:53.297435 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-cb1e3a33-747e-464f-95d3-dc9ca447fa0f tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf67cc7398a4e1cb6f565ebe2241e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df96baa86bb4c51b3b8bece28e3e23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:49:53.306211 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-cb1e3a33-747e-464f-95d3-dc9ca447fa0f tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] 10.222.0.25 "GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e" status: 200 len: 1553 microversion: 2.1 time: 0.241290 May 27 03:49:53.306867 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 590/1128] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:49:53 2021] GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e => generated 1553 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:49:53.361290 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-31738214-6c04-4044-bc35-11884b337b29 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:49:53.362481 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-31738214-6c04-4044-bc35-11884b337b29 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:53.370555 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-31738214-6c04-4044-bc35-11884b337b29 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:53.371018 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-31738214-6c04-4044-bc35-11884b337b29 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:53.371810 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-31738214-6c04-4044-bc35-11884b337b29 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:53.372261 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-31738214-6c04-4044-bc35-11884b337b29 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:53.470721 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-31738214-6c04-4044-bc35-11884b337b29 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 200 len: 28683 microversion: 2.20 time: 0.113948 May 27 03:49:53.472262 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 539/1129] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:49:53 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 28683 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:49:54.092730 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-44501ae1-225b-4c09-8f28-eeb88aa25a5c tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:49:54.094036 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [req-915a7e13-e3d2-4af0-8562-3957bc636bc0 req-77281086-52bf-414d-9aeb-a80d70397468 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962", "tag": "9d0a9265-835b-4677-b698-b6832076290d"}]} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:49:54.096372 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-44501ae1-225b-4c09-8f28-eeb88aa25a5c tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:54.097268 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:49:54.097268 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: warnings.warn(msg) May 27 03:49:54.116159 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-44501ae1-225b-4c09-8f28-eeb88aa25a5c tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:54.116944 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-44501ae1-225b-4c09-8f28-eeb88aa25a5c tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:54.117894 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-44501ae1-225b-4c09-8f28-eeb88aa25a5c tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:54.118522 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-44501ae1-225b-4c09-8f28-eeb88aa25a5c tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:54.123289 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-915a7e13-e3d2-4af0-8562-3957bc636bc0 req-77281086-52bf-414d-9aeb-a80d70397468 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:54.123939 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-915a7e13-e3d2-4af0-8562-3957bc636bc0 req-77281086-52bf-414d-9aeb-a80d70397468 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:54.158352 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.compute.server_external_events [req-915a7e13-e3d2-4af0-8562-3957bc636bc0 req-77281086-52bf-414d-9aeb-a80d70397468 service nova] Creating event network-changed:9d0a9265-835b-4677-b698-b6832076290d for instance 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962 on hv-cinder-79326 May 27 03:49:54.163496 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [req-915a7e13-e3d2-4af0-8562-3957bc636bc0 req-77281086-52bf-414d-9aeb-a80d70397468 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075653 May 27 03:49:54.165028 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 540/1130] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:49:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:49:54.228147 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-44501ae1-225b-4c09-8f28-eeb88aa25a5c tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action" status: 200 len: 14 microversion: 2.1 time: 0.144486 May 27 03:49:54.229508 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 591/1131] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:49:54 2021] POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action => generated 14 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 03:49:54.326391 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-82f7b15d-fb6d-4b95-aa28-9c979933756b tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:49:54.326391 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-82f7b15d-fb6d-4b95-aa28-9c979933756b tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] [instance: daffe717-7636-45e8-813d-8b2a6075c61e] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:54.337108 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-82f7b15d-fb6d-4b95-aa28-9c979933756b tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:54.337697 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-82f7b15d-fb6d-4b95-aa28-9c979933756b tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:54.339459 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-82f7b15d-fb6d-4b95-aa28-9c979933756b tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:54.340851 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-82f7b15d-fb6d-4b95-aa28-9c979933756b tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:54.484845 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-dd929045-8661-467e-bdce-74c13fdfa113 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:49:54.486429 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-dd929045-8661-467e-bdce-74c13fdfa113 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:54.496249 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-dd929045-8661-467e-bdce-74c13fdfa113 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:54.497019 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-dd929045-8661-467e-bdce-74c13fdfa113 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:54.499506 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-dd929045-8661-467e-bdce-74c13fdfa113 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:54.499506 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-dd929045-8661-467e-bdce-74c13fdfa113 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:54.614958 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-dd929045-8661-467e-bdce-74c13fdfa113 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 200 len: 28683 microversion: 2.20 time: 0.135007 May 27 03:49:54.616295 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 592/1132] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:49:54 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 28683 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:49:54.642967 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-82f7b15d-fb6d-4b95-aa28-9c979933756b tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adf67cc7398a4e1cb6f565ebe2241e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0df96baa86bb4c51b3b8bece28e3e23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:49:54.652314 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-82f7b15d-fb6d-4b95-aa28-9c979933756b tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] 10.222.0.25 "GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e" status: 200 len: 1511 microversion: 2.1 time: 0.332861 May 27 03:49:54.653555 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 541/1133] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:49:54 2021] GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e => generated 1511 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:49:55.246558 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-b235173a-d3aa-471e-a6bc-02d0ecebdc68 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:49:55.247582 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-b235173a-d3aa-471e-a6bc-02d0ecebdc68 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:55.262378 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b235173a-d3aa-471e-a6bc-02d0ecebdc68 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:55.263068 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b235173a-d3aa-471e-a6bc-02d0ecebdc68 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:55.263517 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-ee987f62-8c1f-45e4-af3a-1a49b3537e0d tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:49:55.264087 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b235173a-d3aa-471e-a6bc-02d0ecebdc68 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:55.264200 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-ee987f62-8c1f-45e4-af3a-1a49b3537e0d tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] [instance: 02984890-fe33-4d25-bf6d-a3c3163a965f] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:55.264557 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b235173a-d3aa-471e-a6bc-02d0ecebdc68 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:55.274438 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ee987f62-8c1f-45e4-af3a-1a49b3537e0d tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:55.275345 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ee987f62-8c1f-45e4-af3a-1a49b3537e0d tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:55.276976 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ee987f62-8c1f-45e4-af3a-1a49b3537e0d tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:55.277568 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ee987f62-8c1f-45e4-af3a-1a49b3537e0d tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:55.359699 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-ee987f62-8c1f-45e4-af3a-1a49b3537e0d tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] [instance: 02984890-fe33-4d25-bf6d-a3c3163a965f] Going to try to terminate instance {{(pid=113021) delete /opt/stack/nova/nova/compute/api.py:2539}} May 27 03:49:55.387412 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-b235173a-d3aa-471e-a6bc-02d0ecebdc68 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action" status: 200 len: 14 microversion: 2.1 time: 0.151137 May 27 03:49:55.391351 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 593/1134] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:49:55 2021] POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action => generated 14 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 03:49:55.393872 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [req-95ba5cab-9ae4-4b17-9ea9-37f196853e1c req-fabbba59-7798-4d8d-b85e-fb13d6abd00c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02984890-fe33-4d25-bf6d-a3c3163a965f", "tag": "2554297d-a794-4bc9-9cb3-56dce4e9fb2f"}]} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:49:55.396990 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:49:55.396990 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: warnings.warn(msg) May 27 03:49:55.421555 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-95ba5cab-9ae4-4b17-9ea9-37f196853e1c req-fabbba59-7798-4d8d-b85e-fb13d6abd00c service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:55.422125 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-95ba5cab-9ae4-4b17-9ea9-37f196853e1c req-fabbba59-7798-4d8d-b85e-fb13d6abd00c service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:55.456560 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.compute.server_external_events [req-95ba5cab-9ae4-4b17-9ea9-37f196853e1c req-fabbba59-7798-4d8d-b85e-fb13d6abd00c service nova] Creating event network-changed:2554297d-a794-4bc9-9cb3-56dce4e9fb2f for instance 02984890-fe33-4d25-bf6d-a3c3163a965f on hv-cinder-79326 May 27 03:49:55.462048 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [req-95ba5cab-9ae4-4b17-9ea9-37f196853e1c req-fabbba59-7798-4d8d-b85e-fb13d6abd00c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072047 May 27 03:49:55.462678 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 594/1135] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:49:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:49:55.628998 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-ccc46fc7-e31c-445d-b8ef-084dee9e7aec tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:49:55.630010 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-ccc46fc7-e31c-445d-b8ef-084dee9e7aec tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:55.637857 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ccc46fc7-e31c-445d-b8ef-084dee9e7aec tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:55.638845 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ccc46fc7-e31c-445d-b8ef-084dee9e7aec tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:55.639797 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ccc46fc7-e31c-445d-b8ef-084dee9e7aec tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:55.640387 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ccc46fc7-e31c-445d-b8ef-084dee9e7aec tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:55.751857 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-ee987f62-8c1f-45e4-af3a-1a49b3537e0d tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] 10.222.0.25 "DELETE /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f" status: 204 len: 0 microversion: 2.1 time: 0.492946 May 27 03:49:55.756345 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 542/1136] 10.222.0.25 () {58 vars in 1239 bytes} [Thu May 27 03:49:55 2021] DELETE /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f => generated 0 bytes in 496 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 27 03:49:55.758951 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-ccc46fc7-e31c-445d-b8ef-084dee9e7aec tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 200 len: 28683 microversion: 2.20 time: 0.134330 May 27 03:49:55.762914 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-159b0fb8-2b55-48b7-a9be-3381f998106c tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:49:55.763888 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-159b0fb8-2b55-48b7-a9be-3381f998106c tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] [instance: daffe717-7636-45e8-813d-8b2a6075c61e] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:55.764231 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 595/1137] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:49:55 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 28683 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 27 03:49:55.769468 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-2690027e-0afe-40f6-aca7-e1c4f2b60e0c tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:49:55.770563 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-2690027e-0afe-40f6-aca7-e1c4f2b60e0c tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] [instance: 02984890-fe33-4d25-bf6d-a3c3163a965f] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:55.779745 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-159b0fb8-2b55-48b7-a9be-3381f998106c tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:55.780725 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-159b0fb8-2b55-48b7-a9be-3381f998106c tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:55.781988 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-159b0fb8-2b55-48b7-a9be-3381f998106c tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:55.782588 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-159b0fb8-2b55-48b7-a9be-3381f998106c tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:55.800585 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-2690027e-0afe-40f6-aca7-e1c4f2b60e0c tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:55.801436 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-2690027e-0afe-40f6-aca7-e1c4f2b60e0c tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:55.803313 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-2690027e-0afe-40f6-aca7-e1c4f2b60e0c tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:55.805311 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-2690027e-0afe-40f6-aca7-e1c4f2b60e0c tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:55.852524 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.wsgi [None req-159b0fb8-2b55-48b7-a9be-3381f998106c tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] HTTP exception thrown: Instance daffe717-7636-45e8-813d-8b2a6075c61e could not be found. May 27 03:49:55.853410 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-159b0fb8-2b55-48b7-a9be-3381f998106c tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Returning 404 to user: Instance daffe717-7636-45e8-813d-8b2a6075c61e could not be found. {{(pid=113021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 27 03:49:55.854351 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-159b0fb8-2b55-48b7-a9be-3381f998106c tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] 10.222.0.25 "GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e" status: 404 len: 111 microversion: 2.1 time: 0.096105 May 27 03:49:55.858170 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 543/1138] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:49:55 2021] GET /compute/v2.1/servers/daffe717-7636-45e8-813d-8b2a6075c61e => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:49:55.864890 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-2af5eeb5-d46d-4430-8d17-e5be722ee10d tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] Calling method '.version_select at 0x7f98892ea430>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:49:55.953764 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-2af5eeb5-d46d-4430-8d17-e5be722ee10d tempest-TestMinimumBasicScenario-830240683 tempest-TestMinimumBasicScenario-830240683-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-828566615" status: 202 len: 0 microversion: 2.1 time: 0.094342 May 27 03:49:55.957825 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 544/1139] 10.222.0.25 () {58 vars in 1269 bytes} [Thu May 27 03:49:55 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-828566615 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 27 03:49:56.160802 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-2690027e-0afe-40f6-aca7-e1c4f2b60e0c tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023704e9bd7e4bfcace7a3fa2ec9d919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450ff0f7a98a4ae385a74e4ddaf301ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:49:56.170348 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-2690027e-0afe-40f6-aca7-e1c4f2b60e0c tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] 10.222.0.25 "GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f" status: 200 len: 1568 microversion: 2.1 time: 0.404811 May 27 03:49:56.171145 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 596/1140] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:49:55 2021] GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f => generated 1568 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:49:56.202751 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [req-9579f948-3e28-49b9-8210-abbff2a2d982 req-ec4aad2a-919b-448a-ac92-0ce2bd581898 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "daffe717-7636-45e8-813d-8b2a6075c61e", "name": "network-vif-deleted", "tag": "2beacebc-a476-4d0c-ad0f-528ef5b957c8"}]} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:49:56.206509 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:49:56.206509 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: warnings.warn(msg) May 27 03:49:56.219496 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-9579f948-3e28-49b9-8210-abbff2a2d982 req-ec4aad2a-919b-448a-ac92-0ce2bd581898 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:56.225084 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-9579f948-3e28-49b9-8210-abbff2a2d982 req-ec4aad2a-919b-448a-ac92-0ce2bd581898 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:56.244556 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.compute.server_external_events [req-9579f948-3e28-49b9-8210-abbff2a2d982 req-ec4aad2a-919b-448a-ac92-0ce2bd581898 service nova] Creating event network-vif-deleted:2beacebc-a476-4d0c-ad0f-528ef5b957c8 for instance daffe717-7636-45e8-813d-8b2a6075c61e on hv-cinder-79326 May 27 03:49:56.260667 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [req-9579f948-3e28-49b9-8210-abbff2a2d982 req-ec4aad2a-919b-448a-ac92-0ce2bd581898 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061743 May 27 03:49:56.261898 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 545/1141] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:49:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:49:56.400392 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-d3cab85f-a6d7-40f2-a608-a2788a9cf717 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:49:56.402554 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-d3cab85f-a6d7-40f2-a608-a2788a9cf717 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:56.412284 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d3cab85f-a6d7-40f2-a608-a2788a9cf717 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:56.412844 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d3cab85f-a6d7-40f2-a608-a2788a9cf717 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:56.419787 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d3cab85f-a6d7-40f2-a608-a2788a9cf717 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:56.419787 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d3cab85f-a6d7-40f2-a608-a2788a9cf717 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:56.516675 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-d3cab85f-a6d7-40f2-a608-a2788a9cf717 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action" status: 200 len: 14 microversion: 2.1 time: 0.121792 May 27 03:49:56.517311 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 597/1142] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:49:56 2021] POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action => generated 14 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 03:49:56.771395 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-3841b308-101a-4df0-bce4-7a4e9c729433 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:49:56.772442 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-3841b308-101a-4df0-bce4-7a4e9c729433 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:56.780905 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-3841b308-101a-4df0-bce4-7a4e9c729433 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:56.781362 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-3841b308-101a-4df0-bce4-7a4e9c729433 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:56.782399 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-3841b308-101a-4df0-bce4-7a4e9c729433 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:56.782839 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-3841b308-101a-4df0-bce4-7a4e9c729433 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:56.880553 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-3841b308-101a-4df0-bce4-7a4e9c729433 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 200 len: 28683 microversion: 2.20 time: 0.113162 May 27 03:49:56.881176 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 546/1143] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:49:56 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 28683 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:49:57.188511 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-43a9a11c-4918-49c5-b200-6c7b692374a5 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:49:57.189249 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-43a9a11c-4918-49c5-b200-6c7b692374a5 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] [instance: 02984890-fe33-4d25-bf6d-a3c3163a965f] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:57.197779 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-43a9a11c-4918-49c5-b200-6c7b692374a5 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:57.198268 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-43a9a11c-4918-49c5-b200-6c7b692374a5 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:57.199028 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-43a9a11c-4918-49c5-b200-6c7b692374a5 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:57.199458 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-43a9a11c-4918-49c5-b200-6c7b692374a5 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:57.401160 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-43a9a11c-4918-49c5-b200-6c7b692374a5 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023704e9bd7e4bfcace7a3fa2ec9d919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450ff0f7a98a4ae385a74e4ddaf301ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:49:57.409765 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-43a9a11c-4918-49c5-b200-6c7b692374a5 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] 10.222.0.25 "GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f" status: 200 len: 1451 microversion: 2.1 time: 0.225573 May 27 03:49:57.410343 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 598/1144] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:49:57 2021] GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f => generated 1451 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:49:57.527553 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-1ce455ce-28cc-4f9f-82b4-dc2740f19d74 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:49:57.528665 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-1ce455ce-28cc-4f9f-82b4-dc2740f19d74 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:57.573042 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1ce455ce-28cc-4f9f-82b4-dc2740f19d74 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:57.573491 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1ce455ce-28cc-4f9f-82b4-dc2740f19d74 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:57.574271 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1ce455ce-28cc-4f9f-82b4-dc2740f19d74 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:57.574708 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1ce455ce-28cc-4f9f-82b4-dc2740f19d74 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:57.668835 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-1ce455ce-28cc-4f9f-82b4-dc2740f19d74 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action" status: 200 len: 14 microversion: 2.1 time: 0.145133 May 27 03:49:57.672453 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 547/1145] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:49:57 2021] POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action => generated 14 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 03:49:57.892887 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-9d911168-d499-41d5-a524-2cf3d0304efb tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:49:57.893854 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-9d911168-d499-41d5-a524-2cf3d0304efb tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:57.901573 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9d911168-d499-41d5-a524-2cf3d0304efb tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:57.902020 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9d911168-d499-41d5-a524-2cf3d0304efb tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:57.902792 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9d911168-d499-41d5-a524-2cf3d0304efb tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:57.903230 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9d911168-d499-41d5-a524-2cf3d0304efb tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:58.008674 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-9d911168-d499-41d5-a524-2cf3d0304efb tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 200 len: 28683 microversion: 2.20 time: 0.119215 May 27 03:49:58.013142 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 599/1146] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:49:57 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 28683 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 27 03:49:58.427630 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-7ad5c437-076d-408a-a547-5c525841a42a tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:49:58.434316 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-7ad5c437-076d-408a-a547-5c525841a42a tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] [instance: 02984890-fe33-4d25-bf6d-a3c3163a965f] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:58.436811 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-7ad5c437-076d-408a-a547-5c525841a42a tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:58.437273 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-7ad5c437-076d-408a-a547-5c525841a42a tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:58.438055 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-7ad5c437-076d-408a-a547-5c525841a42a tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:58.438495 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-7ad5c437-076d-408a-a547-5c525841a42a tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:58.679810 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-bd4920b0-d680-4773-a3e1-fc0c2f96a93e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:49:58.681441 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-bd4920b0-d680-4773-a3e1-fc0c2f96a93e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:58.689442 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-bd4920b0-d680-4773-a3e1-fc0c2f96a93e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:58.689893 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-bd4920b0-d680-4773-a3e1-fc0c2f96a93e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:58.690658 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-bd4920b0-d680-4773-a3e1-fc0c2f96a93e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:58.691093 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-bd4920b0-d680-4773-a3e1-fc0c2f96a93e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:58.783477 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-bd4920b0-d680-4773-a3e1-fc0c2f96a93e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action" status: 200 len: 14 microversion: 2.1 time: 0.107672 May 27 03:49:58.786946 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 600/1147] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:49:58 2021] POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 27 03:49:59.021138 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-afb620c9-47f5-4946-85e9-455f6f9b889d tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:49:59.022283 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-afb620c9-47f5-4946-85e9-455f6f9b889d tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:59.030335 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-afb620c9-47f5-4946-85e9-455f6f9b889d tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:59.030871 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-afb620c9-47f5-4946-85e9-455f6f9b889d tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:59.032084 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-afb620c9-47f5-4946-85e9-455f6f9b889d tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:59.032383 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-afb620c9-47f5-4946-85e9-455f6f9b889d tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:59.050776 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-7ad5c437-076d-408a-a547-5c525841a42a tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023704e9bd7e4bfcace7a3fa2ec9d919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450ff0f7a98a4ae385a74e4ddaf301ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:49:59.059734 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-7ad5c437-076d-408a-a547-5c525841a42a tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] 10.222.0.25 "GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f" status: 200 len: 1451 microversion: 2.1 time: 0.636204 May 27 03:49:59.060616 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 548/1148] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:49:58 2021] GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f => generated 1451 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:49:59.130489 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-afb620c9-47f5-4946-85e9-455f6f9b889d tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 200 len: 28683 microversion: 2.20 time: 0.113503 May 27 03:49:59.131048 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 601/1149] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:49:59 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 28683 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 27 03:49:59.409243 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [req-419e3993-9238-4c09-ad7c-87e000fb3a84 req-27252ef0-294f-4ce8-b160-c65aab87800d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02984890-fe33-4d25-bf6d-a3c3163a965f", "name": "network-vif-deleted", "tag": "2554297d-a794-4bc9-9cb3-56dce4e9fb2f"}]} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:49:59.410802 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:49:59.410802 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: warnings.warn(msg) May 27 03:49:59.420282 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-419e3993-9238-4c09-ad7c-87e000fb3a84 req-27252ef0-294f-4ce8-b160-c65aab87800d service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:59.420282 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-419e3993-9238-4c09-ad7c-87e000fb3a84 req-27252ef0-294f-4ce8-b160-c65aab87800d service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:59.436506 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.compute.server_external_events [req-419e3993-9238-4c09-ad7c-87e000fb3a84 req-27252ef0-294f-4ce8-b160-c65aab87800d service nova] Creating event network-vif-deleted:2554297d-a794-4bc9-9cb3-56dce4e9fb2f for instance 02984890-fe33-4d25-bf6d-a3c3163a965f on hv-cinder-79326 May 27 03:49:59.441232 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [req-419e3993-9238-4c09-ad7c-87e000fb3a84 req-27252ef0-294f-4ce8-b160-c65aab87800d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035783 May 27 03:49:59.441763 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 549/1150] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:49:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:49:59.795078 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-a67d98f4-49d6-4349-b909-46ce5a910df6 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:49:59.796186 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-a67d98f4-49d6-4349-b909-46ce5a910df6 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:49:59.804360 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a67d98f4-49d6-4349-b909-46ce5a910df6 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:59.804890 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a67d98f4-49d6-4349-b909-46ce5a910df6 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:59.805856 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a67d98f4-49d6-4349-b909-46ce5a910df6 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:49:59.806292 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a67d98f4-49d6-4349-b909-46ce5a910df6 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:49:59.900811 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-a67d98f4-49d6-4349-b909-46ce5a910df6 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action" status: 200 len: 14 microversion: 2.1 time: 0.109612 May 27 03:49:59.903966 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 602/1151] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:49:59 2021] POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 03:50:00.077803 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-49e6c692-b4af-4219-aae3-39a04355383f tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:50:00.078508 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-49e6c692-b4af-4219-aae3-39a04355383f tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] [instance: 02984890-fe33-4d25-bf6d-a3c3163a965f] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:00.086316 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-49e6c692-b4af-4219-aae3-39a04355383f tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:00.092182 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-49e6c692-b4af-4219-aae3-39a04355383f tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:00.092182 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-49e6c692-b4af-4219-aae3-39a04355383f tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:00.092182 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-49e6c692-b4af-4219-aae3-39a04355383f tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:00.147368 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-6f82b5bb-d3a9-4e26-9c89-bf6df37ec808 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:00.148436 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-6f82b5bb-d3a9-4e26-9c89-bf6df37ec808 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:00.158462 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6f82b5bb-d3a9-4e26-9c89-bf6df37ec808 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:00.159120 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6f82b5bb-d3a9-4e26-9c89-bf6df37ec808 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:00.160101 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6f82b5bb-d3a9-4e26-9c89-bf6df37ec808 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:00.160575 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6f82b5bb-d3a9-4e26-9c89-bf6df37ec808 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:00.264262 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-6f82b5bb-d3a9-4e26-9c89-bf6df37ec808 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 200 len: 28683 microversion: 2.20 time: 0.121272 May 27 03:50:00.264945 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 603/1152] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:50:00 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 28683 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:50:00.451587 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-49e6c692-b4af-4219-aae3-39a04355383f tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '023704e9bd7e4bfcace7a3fa2ec9d919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '450ff0f7a98a4ae385a74e4ddaf301ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:00.460052 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-49e6c692-b4af-4219-aae3-39a04355383f tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] 10.222.0.25 "GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f" status: 200 len: 1219 microversion: 2.1 time: 0.386504 May 27 03:50:00.460647 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 550/1153] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:50:00 2021] GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f => generated 1219 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:50:00.912187 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-d335c208-df07-4e72-8439-dfc9bcd3e31a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:00.913855 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-d335c208-df07-4e72-8439-dfc9bcd3e31a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:00.923157 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d335c208-df07-4e72-8439-dfc9bcd3e31a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:00.923863 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d335c208-df07-4e72-8439-dfc9bcd3e31a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:00.924686 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d335c208-df07-4e72-8439-dfc9bcd3e31a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:00.925153 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d335c208-df07-4e72-8439-dfc9bcd3e31a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:01.051381 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-d335c208-df07-4e72-8439-dfc9bcd3e31a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action" status: 200 len: 14 microversion: 2.1 time: 0.141104 May 27 03:50:01.051381 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 604/1154] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:50:00 2021] POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action => generated 14 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 27 03:50:01.276702 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-b32a69b5-6a6c-4890-a9ba-cb90cc1d2f97 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:01.277632 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-b32a69b5-6a6c-4890-a9ba-cb90cc1d2f97 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:01.285294 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b32a69b5-6a6c-4890-a9ba-cb90cc1d2f97 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:01.285750 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b32a69b5-6a6c-4890-a9ba-cb90cc1d2f97 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:01.286530 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b32a69b5-6a6c-4890-a9ba-cb90cc1d2f97 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:01.286972 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b32a69b5-6a6c-4890-a9ba-cb90cc1d2f97 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:01.383066 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-b32a69b5-6a6c-4890-a9ba-cb90cc1d2f97 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 200 len: 28683 microversion: 2.20 time: 0.110498 May 27 03:50:01.384980 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 551/1155] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:50:01 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 28683 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:50:01.477296 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-38d7a44a-ce23-4ab2-b752-7ce065dfb1b7 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:50:01.478400 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-38d7a44a-ce23-4ab2-b752-7ce065dfb1b7 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] [instance: 02984890-fe33-4d25-bf6d-a3c3163a965f] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:01.487215 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-38d7a44a-ce23-4ab2-b752-7ce065dfb1b7 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:01.487745 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-38d7a44a-ce23-4ab2-b752-7ce065dfb1b7 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:01.488852 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-38d7a44a-ce23-4ab2-b752-7ce065dfb1b7 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:01.489391 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-38d7a44a-ce23-4ab2-b752-7ce065dfb1b7 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:01.543779 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.wsgi [None req-38d7a44a-ce23-4ab2-b752-7ce065dfb1b7 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] HTTP exception thrown: Instance 02984890-fe33-4d25-bf6d-a3c3163a965f could not be found. May 27 03:50:01.544496 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-38d7a44a-ce23-4ab2-b752-7ce065dfb1b7 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Returning 404 to user: Instance 02984890-fe33-4d25-bf6d-a3c3163a965f could not be found. {{(pid=113020) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 27 03:50:01.545413 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-38d7a44a-ce23-4ab2-b752-7ce065dfb1b7 tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] 10.222.0.25 "GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f" status: 404 len: 111 microversion: 2.1 time: 0.072400 May 27 03:50:01.546141 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 605/1156] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:50:01 2021] GET /compute/v2.1/servers/02984890-fe33-4d25-bf6d-a3c3163a965f => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:50:02.064226 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-4b564ada-70b3-4900-b4fc-50d2c255dc3f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:02.065272 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-4b564ada-70b3-4900-b4fc-50d2c255dc3f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:02.073628 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-4b564ada-70b3-4900-b4fc-50d2c255dc3f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:02.074175 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-4b564ada-70b3-4900-b4fc-50d2c255dc3f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:02.075134 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-4b564ada-70b3-4900-b4fc-50d2c255dc3f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:02.075817 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-4b564ada-70b3-4900-b4fc-50d2c255dc3f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:02.143031 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-f2851efd-ae48-471b-bad9-9edd8b2bb62f tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] Calling method '.version_select at 0x7f988817f8b0>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:50:02.192798 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-4b564ada-70b3-4900-b4fc-50d2c255dc3f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action" status: 200 len: 14 microversion: 2.1 time: 0.132364 May 27 03:50:02.193358 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 552/1157] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:50:02 2021] POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action => generated 14 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 27 03:50:02.231764 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-f2851efd-ae48-471b-bad9-9edd8b2bb62f tempest-TestShelveInstance-346331258 tempest-TestShelveInstance-346331258-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-448446547" status: 202 len: 0 microversion: 2.1 time: 0.092908 May 27 03:50:02.232958 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 606/1158] 10.222.0.25 () {58 vars in 1251 bytes} [Thu May 27 03:50:02 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-448446547 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:50:02.396303 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-97a3cf78-8b30-43c2-b87e-6258516223d4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:02.397412 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-97a3cf78-8b30-43c2-b87e-6258516223d4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:02.405701 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-97a3cf78-8b30-43c2-b87e-6258516223d4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:02.406157 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-97a3cf78-8b30-43c2-b87e-6258516223d4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:02.407193 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-97a3cf78-8b30-43c2-b87e-6258516223d4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:02.408608 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-97a3cf78-8b30-43c2-b87e-6258516223d4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:02.500882 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-97a3cf78-8b30-43c2-b87e-6258516223d4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 200 len: 28683 microversion: 2.20 time: 0.108849 May 27 03:50:02.502254 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 553/1159] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:50:02 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 28683 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:50:03.203938 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-f2898d8d-59d9-4025-9564-5f3ae619e23a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:03.204942 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-f2898d8d-59d9-4025-9564-5f3ae619e23a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:03.218288 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f2898d8d-59d9-4025-9564-5f3ae619e23a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:03.218674 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f2898d8d-59d9-4025-9564-5f3ae619e23a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:03.219456 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f2898d8d-59d9-4025-9564-5f3ae619e23a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:03.219896 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f2898d8d-59d9-4025-9564-5f3ae619e23a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:03.339989 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-f2898d8d-59d9-4025-9564-5f3ae619e23a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action" status: 200 len: 14 microversion: 2.1 time: 0.140077 May 27 03:50:03.341152 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 607/1160] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:50:03 2021] POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action => generated 14 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 03:50:03.426909 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-1938884f-4e35-4823-a46f-505d4bb47f5d tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-265440673", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-482559929", "security_groups": [{"name": "tempest-secgroup-smoke-1920270131"}], "block_device_mapping_v2": [{"uuid": "8f8e4acc-5a71-4854-bfef-3837cd8896aa", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e3d5c143-f0ba-4a03-b1d4-d1be1e83dd0f"}]}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:03.515037 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-cc7c9c2b-8bfc-4846-890b-2da274a0ba04 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:03.516123 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-cc7c9c2b-8bfc-4846-890b-2da274a0ba04 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:03.534405 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-cc7c9c2b-8bfc-4846-890b-2da274a0ba04 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:03.534866 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-cc7c9c2b-8bfc-4846-890b-2da274a0ba04 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:03.535792 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-cc7c9c2b-8bfc-4846-890b-2da274a0ba04 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:03.536438 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-cc7c9c2b-8bfc-4846-890b-2da274a0ba04 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:03.664622 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-cc7c9c2b-8bfc-4846-890b-2da274a0ba04 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 200 len: 28683 microversion: 2.20 time: 0.154211 May 27 03:50:03.669725 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 608/1161] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:50:03 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 28683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:50:03.891903 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.network.neutron [None req-1938884f-4e35-4823-a46f-505d4bb47f5d tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] validate_networks() for [('e3d5c143-f0ba-4a03-b1d4-d1be1e83dd0f', None, None, None)] {{(pid=113021) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 27 03:50:04.351898 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-6deac608-39fb-4141-a4ad-1c1afbf0e4e4 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:04.354480 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-6deac608-39fb-4141-a4ad-1c1afbf0e4e4 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:04.372985 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6deac608-39fb-4141-a4ad-1c1afbf0e4e4 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:04.373489 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6deac608-39fb-4141-a4ad-1c1afbf0e4e4 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:04.374472 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6deac608-39fb-4141-a4ad-1c1afbf0e4e4 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:04.375093 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6deac608-39fb-4141-a4ad-1c1afbf0e4e4 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:04.513894 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-6deac608-39fb-4141-a4ad-1c1afbf0e4e4 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action" status: 200 len: 6451 microversion: 2.1 time: 0.165724 May 27 03:50:04.517092 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 609/1162] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:50:04 2021] POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action => generated 6451 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:50:04.681101 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-e164f765-1b5d-44ba-8328-d94e95cb7fa1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:04.681101 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-e164f765-1b5d-44ba-8328-d94e95cb7fa1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:04.687560 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e164f765-1b5d-44ba-8328-d94e95cb7fa1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:04.688016 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e164f765-1b5d-44ba-8328-d94e95cb7fa1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:04.688814 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e164f765-1b5d-44ba-8328-d94e95cb7fa1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:04.689363 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e164f765-1b5d-44ba-8328-d94e95cb7fa1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:04.792791 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-e164f765-1b5d-44ba-8328-d94e95cb7fa1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 200 len: 28683 microversion: 2.20 time: 0.119000 May 27 03:50:04.794302 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 610/1163] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:50:04 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 28683 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 27 03:50:05.244241 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.virt.hardware [None req-1938884f-4e35-4823-a46f-505d4bb47f5d tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Flavor limits 0:0:0 {{(pid=113021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 27 03:50:05.244700 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.virt.hardware [None req-1938884f-4e35-4823-a46f-505d4bb47f5d tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Image limits 0:0:0 {{(pid=113021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 27 03:50:05.247100 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.virt.hardware [None req-1938884f-4e35-4823-a46f-505d4bb47f5d tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Flavor pref 0:0:0 {{(pid=113021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 27 03:50:05.247100 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.virt.hardware [None req-1938884f-4e35-4823-a46f-505d4bb47f5d tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Image pref 0:0:0 {{(pid=113021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 27 03:50:05.247100 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.virt.hardware [None req-1938884f-4e35-4823-a46f-505d4bb47f5d tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=113021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 27 03:50:05.254590 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1938884f-4e35-4823-a46f-505d4bb47f5d tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:05.255261 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1938884f-4e35-4823-a46f-505d4bb47f5d tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:05.256069 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1938884f-4e35-4823-a46f-505d4bb47f5d tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:05.256579 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1938884f-4e35-4823-a46f-505d4bb47f5d tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:05.278815 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.quota [None req-1938884f-4e35-4823-a46f-505d4bb47f5d tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Getting quotas for project 6b6a582a2a304a7d881efcfa2373dfb1. Resources: {'instances', 'cores', 'ram'} {{(pid=113021) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 27 03:50:05.283493 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.quota [None req-1938884f-4e35-4823-a46f-505d4bb47f5d tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Getting quotas for user 4fba01f5f17648a7a1fd0fbefd56e046 and project 6b6a582a2a304a7d881efcfa2373dfb1. Resources: {'instances', 'cores', 'ram'} {{(pid=113021) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 27 03:50:05.397684 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-1938884f-4e35-4823-a46f-505d4bb47f5d tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Going to run 1 instances... {{(pid=113021) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 27 03:50:05.400195 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-1938884f-4e35-4823-a46f-505d4bb47f5d tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: 8f32a2a3-7d2a-4396-8a34-0ebe6dda5782] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8f8e4acc-5a71-4854-bfef-3837cd8896aa',volume_size=None,volume_type=None)] {{(pid=113021) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 27 03:50:05.527833 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-21e70176-fd0c-46af-9276-88197f6457f4 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:05.529600 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-21e70176-fd0c-46af-9276-88197f6457f4 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:05.546621 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-21e70176-fd0c-46af-9276-88197f6457f4 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:05.547517 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-21e70176-fd0c-46af-9276-88197f6457f4 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:05.551488 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-21e70176-fd0c-46af-9276-88197f6457f4 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:05.552156 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-21e70176-fd0c-46af-9276-88197f6457f4 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:05.698296 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-21e70176-fd0c-46af-9276-88197f6457f4 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action" status: 200 len: 15374 microversion: 2.1 time: 0.176692 May 27 03:50:05.706927 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 611/1164] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:50:05 2021] POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action => generated 15374 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 03:50:05.808397 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-6a876f8e-3996-4a57-ace6-21c078701b65 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:05.809579 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-6a876f8e-3996-4a57-ace6-21c078701b65 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:05.835033 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6a876f8e-3996-4a57-ace6-21c078701b65 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:05.836595 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6a876f8e-3996-4a57-ace6-21c078701b65 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:05.838156 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6a876f8e-3996-4a57-ace6-21c078701b65 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:05.839153 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6a876f8e-3996-4a57-ace6-21c078701b65 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:05.937517 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-1938884f-4e35-4823-a46f-505d4bb47f5d tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.520308 May 27 03:50:05.942202 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 554/1165] 10.222.0.25 () {60 vars in 1147 bytes} [Thu May 27 03:50:03 2021] POST /compute/v2.1/servers => generated 406 bytes in 2526 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 03:50:05.956484 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-6a876f8e-3996-4a57-ace6-21c078701b65 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 200 len: 28683 microversion: 2.20 time: 0.154169 May 27 03:50:05.967513 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-b851f45f-29b8-4267-b4fe-eeb650b94595 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:50:05.968256 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-b851f45f-29b8-4267-b4fe-eeb650b94595 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: 8f32a2a3-7d2a-4396-8a34-0ebe6dda5782] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:05.969213 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 612/1166] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:50:05 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 28683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:50:06.108470 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-b851f45f-29b8-4267-b4fe-eeb650b94595 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fba01f5f17648a7a1fd0fbefd56e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6a582a2a304a7d881efcfa2373dfb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:06.116680 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-b851f45f-29b8-4267-b4fe-eeb650b94595 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/8f32a2a3-7d2a-4396-8a34-0ebe6dda5782" status: 200 len: 1093 microversion: 2.1 time: 0.158833 May 27 03:50:06.123141 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 555/1167] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:50:05 2021] GET /compute/v2.1/servers/8f32a2a3-7d2a-4396-8a34-0ebe6dda5782 => generated 1093 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:50:06.716049 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-c1737d08-ffad-4012-8675-336325d38f08 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:06.718040 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-c1737d08-ffad-4012-8675-336325d38f08 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:06.728633 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c1737d08-ffad-4012-8675-336325d38f08 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:06.729406 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c1737d08-ffad-4012-8675-336325d38f08 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:06.730513 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c1737d08-ffad-4012-8675-336325d38f08 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:06.731123 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c1737d08-ffad-4012-8675-336325d38f08 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:06.847590 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-c1737d08-ffad-4012-8675-336325d38f08 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action" status: 200 len: 18561 microversion: 2.1 time: 0.136474 May 27 03:50:06.848706 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 613/1168] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:50:06 2021] POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action => generated 18561 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:50:06.968335 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-a46bfba1-06a8-4574-a20a-b10c801915a3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:06.969592 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-a46bfba1-06a8-4574-a20a-b10c801915a3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:06.978447 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a46bfba1-06a8-4574-a20a-b10c801915a3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:06.979325 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a46bfba1-06a8-4574-a20a-b10c801915a3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:06.980526 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a46bfba1-06a8-4574-a20a-b10c801915a3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:06.981131 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a46bfba1-06a8-4574-a20a-b10c801915a3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:07.115471 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-a46bfba1-06a8-4574-a20a-b10c801915a3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 200 len: 28683 microversion: 2.20 time: 0.150472 May 27 03:50:07.121106 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 556/1169] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:50:06 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 28683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:50:07.142043 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-92585004-dd2d-478c-9ca6-548b86cf87a5 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:50:07.142737 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-92585004-dd2d-478c-9ca6-548b86cf87a5 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: 8f32a2a3-7d2a-4396-8a34-0ebe6dda5782] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:07.157106 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-92585004-dd2d-478c-9ca6-548b86cf87a5 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:07.157532 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-92585004-dd2d-478c-9ca6-548b86cf87a5 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:07.161063 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-92585004-dd2d-478c-9ca6-548b86cf87a5 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:07.161063 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-92585004-dd2d-478c-9ca6-548b86cf87a5 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:07.296441 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-92585004-dd2d-478c-9ca6-548b86cf87a5 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fba01f5f17648a7a1fd0fbefd56e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6a582a2a304a7d881efcfa2373dfb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:07.317214 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-92585004-dd2d-478c-9ca6-548b86cf87a5 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/8f32a2a3-7d2a-4396-8a34-0ebe6dda5782" status: 200 len: 1143 microversion: 2.1 time: 0.181626 May 27 03:50:07.318249 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 614/1170] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:50:07 2021] GET /compute/v2.1/servers/8f32a2a3-7d2a-4396-8a34-0ebe6dda5782 => generated 1143 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:50:07.859714 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-6453727b-8f93-435a-931f-eec93984dc6a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:07.861070 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-6453727b-8f93-435a-931f-eec93984dc6a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:07.869729 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6453727b-8f93-435a-931f-eec93984dc6a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:07.873270 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6453727b-8f93-435a-931f-eec93984dc6a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:07.873270 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6453727b-8f93-435a-931f-eec93984dc6a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:07.873270 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6453727b-8f93-435a-931f-eec93984dc6a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:07.972393 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-6453727b-8f93-435a-931f-eec93984dc6a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action" status: 200 len: 20997 microversion: 2.1 time: 0.116404 May 27 03:50:07.973119 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 557/1171] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:50:07 2021] POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action => generated 20997 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:50:08.128416 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-0f2ede00-9c81-4a61-b188-9d006fa8b476 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:08.131558 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-0f2ede00-9c81-4a61-b188-9d006fa8b476 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:08.150744 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0f2ede00-9c81-4a61-b188-9d006fa8b476 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:08.151557 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0f2ede00-9c81-4a61-b188-9d006fa8b476 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:08.152597 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0f2ede00-9c81-4a61-b188-9d006fa8b476 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:08.153266 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0f2ede00-9c81-4a61-b188-9d006fa8b476 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:08.335523 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-da645885-ebd2-42c2-b2fd-f73a62b6f348 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:50:08.336708 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-da645885-ebd2-42c2-b2fd-f73a62b6f348 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: 8f32a2a3-7d2a-4396-8a34-0ebe6dda5782] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:08.345781 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-da645885-ebd2-42c2-b2fd-f73a62b6f348 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:08.346617 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-da645885-ebd2-42c2-b2fd-f73a62b6f348 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:08.347803 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-da645885-ebd2-42c2-b2fd-f73a62b6f348 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:08.348481 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-da645885-ebd2-42c2-b2fd-f73a62b6f348 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:08.353306 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-0f2ede00-9c81-4a61-b188-9d006fa8b476 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 200 len: 28683 microversion: 2.20 time: 0.223905 May 27 03:50:08.355010 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 615/1172] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:50:08 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 28683 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:50:08.576601 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-da645885-ebd2-42c2-b2fd-f73a62b6f348 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fba01f5f17648a7a1fd0fbefd56e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6a582a2a304a7d881efcfa2373dfb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:08.585004 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-da645885-ebd2-42c2-b2fd-f73a62b6f348 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/8f32a2a3-7d2a-4396-8a34-0ebe6dda5782" status: 200 len: 1199 microversion: 2.1 time: 0.253672 May 27 03:50:08.585749 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 558/1173] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:50:08 2021] GET /compute/v2.1/servers/8f32a2a3-7d2a-4396-8a34-0ebe6dda5782 => generated 1199 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:50:09.002303 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-46c09f5e-2f37-4b8c-a516-28be339380c3 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:09.005222 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-46c09f5e-2f37-4b8c-a516-28be339380c3 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:09.017627 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-46c09f5e-2f37-4b8c-a516-28be339380c3 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:09.021528 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-46c09f5e-2f37-4b8c-a516-28be339380c3 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:09.021528 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-46c09f5e-2f37-4b8c-a516-28be339380c3 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:09.021528 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-46c09f5e-2f37-4b8c-a516-28be339380c3 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:09.139311 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-46c09f5e-2f37-4b8c-a516-28be339380c3 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action" status: 200 len: 22981 microversion: 2.1 time: 0.150265 May 27 03:50:09.142461 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 616/1174] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:50:08 2021] POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action => generated 22981 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:50:09.366267 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-a4b97882-d8b9-447c-952e-4ae75dbb2f1f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:09.367566 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-a4b97882-d8b9-447c-952e-4ae75dbb2f1f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:09.376642 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a4b97882-d8b9-447c-952e-4ae75dbb2f1f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:09.377100 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a4b97882-d8b9-447c-952e-4ae75dbb2f1f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:09.377901 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a4b97882-d8b9-447c-952e-4ae75dbb2f1f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:09.378397 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a4b97882-d8b9-447c-952e-4ae75dbb2f1f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:09.478178 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-a4b97882-d8b9-447c-952e-4ae75dbb2f1f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 200 len: 28683 microversion: 2.20 time: 0.115250 May 27 03:50:09.480445 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 559/1175] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:50:09 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 28683 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:50:09.603764 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-8f73e5d2-2e8a-4e0d-ab78-27ada65017b9 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:50:09.605204 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-8f73e5d2-2e8a-4e0d-ab78-27ada65017b9 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: 8f32a2a3-7d2a-4396-8a34-0ebe6dda5782] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:09.613389 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8f73e5d2-2e8a-4e0d-ab78-27ada65017b9 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:09.613847 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8f73e5d2-2e8a-4e0d-ab78-27ada65017b9 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:09.614627 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8f73e5d2-2e8a-4e0d-ab78-27ada65017b9 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:09.615279 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8f73e5d2-2e8a-4e0d-ab78-27ada65017b9 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:09.821926 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-8f73e5d2-2e8a-4e0d-ab78-27ada65017b9 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fba01f5f17648a7a1fd0fbefd56e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6a582a2a304a7d881efcfa2373dfb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:09.836782 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-8f73e5d2-2e8a-4e0d-ab78-27ada65017b9 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/8f32a2a3-7d2a-4396-8a34-0ebe6dda5782" status: 200 len: 1209 microversion: 2.1 time: 0.237354 May 27 03:50:09.837907 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 617/1176] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:50:09 2021] GET /compute/v2.1/servers/8f32a2a3-7d2a-4396-8a34-0ebe6dda5782 => generated 1209 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:50:10.154263 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-59a8f1cf-54d5-4a9e-b361-a09e0999c95d tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:10.155434 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-59a8f1cf-54d5-4a9e-b361-a09e0999c95d tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:10.179450 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-59a8f1cf-54d5-4a9e-b361-a09e0999c95d tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:10.180174 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-59a8f1cf-54d5-4a9e-b361-a09e0999c95d tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:10.181903 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-59a8f1cf-54d5-4a9e-b361-a09e0999c95d tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:10.182498 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-59a8f1cf-54d5-4a9e-b361-a09e0999c95d tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:10.296988 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-59a8f1cf-54d5-4a9e-b361-a09e0999c95d tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action" status: 200 len: 24347 microversion: 2.1 time: 0.148291 May 27 03:50:10.297948 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 560/1177] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:50:10 2021] POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action => generated 24347 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:50:10.494000 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-bd02b107-5657-4563-be8c-6a4385a30de4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:10.495433 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-bd02b107-5657-4563-be8c-6a4385a30de4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:10.506154 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-bd02b107-5657-4563-be8c-6a4385a30de4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:10.509937 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-bd02b107-5657-4563-be8c-6a4385a30de4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:10.509937 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-bd02b107-5657-4563-be8c-6a4385a30de4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:10.509937 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-bd02b107-5657-4563-be8c-6a4385a30de4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:10.625411 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-bd02b107-5657-4563-be8c-6a4385a30de4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 200 len: 28683 microversion: 2.20 time: 0.137636 May 27 03:50:10.626250 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 618/1178] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:50:10 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 28683 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 27 03:50:10.855024 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-364f9923-9d14-4b91-ac89-eb32ea936602 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:50:10.855974 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-364f9923-9d14-4b91-ac89-eb32ea936602 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: 8f32a2a3-7d2a-4396-8a34-0ebe6dda5782] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:10.864368 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-364f9923-9d14-4b91-ac89-eb32ea936602 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:10.865128 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-364f9923-9d14-4b91-ac89-eb32ea936602 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:10.866133 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-364f9923-9d14-4b91-ac89-eb32ea936602 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:10.866650 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-364f9923-9d14-4b91-ac89-eb32ea936602 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:11.310252 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-eb2b26e5-1d0b-4e20-9aea-c7617beaa272 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:11.311375 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-eb2b26e5-1d0b-4e20-9aea-c7617beaa272 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:11.322949 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-eb2b26e5-1d0b-4e20-9aea-c7617beaa272 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:11.324151 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-eb2b26e5-1d0b-4e20-9aea-c7617beaa272 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:11.325188 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-eb2b26e5-1d0b-4e20-9aea-c7617beaa272 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:11.325907 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-eb2b26e5-1d0b-4e20-9aea-c7617beaa272 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:11.423973 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-eb2b26e5-1d0b-4e20-9aea-c7617beaa272 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action" status: 200 len: 26031 microversion: 2.1 time: 0.118198 May 27 03:50:11.428324 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 619/1179] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:50:11 2021] POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action => generated 26031 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 03:50:11.638944 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-77d42851-d836-451f-879d-a88fe0216766 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:11.640262 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-77d42851-d836-451f-879d-a88fe0216766 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:11.648966 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-77d42851-d836-451f-879d-a88fe0216766 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:11.649515 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-77d42851-d836-451f-879d-a88fe0216766 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:11.650514 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-77d42851-d836-451f-879d-a88fe0216766 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:11.651178 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-77d42851-d836-451f-879d-a88fe0216766 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:11.653212 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-364f9923-9d14-4b91-ac89-eb32ea936602 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fba01f5f17648a7a1fd0fbefd56e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6a582a2a304a7d881efcfa2373dfb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:11.665243 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-364f9923-9d14-4b91-ac89-eb32ea936602 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/8f32a2a3-7d2a-4396-8a34-0ebe6dda5782" status: 200 len: 1265 microversion: 2.1 time: 0.813881 May 27 03:50:11.671117 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 561/1180] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:50:10 2021] GET /compute/v2.1/servers/8f32a2a3-7d2a-4396-8a34-0ebe6dda5782 => generated 1265 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:50:11.751848 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-77d42851-d836-451f-879d-a88fe0216766 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 200 len: 28683 microversion: 2.20 time: 0.117961 May 27 03:50:11.753263 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 620/1181] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:50:11 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 28683 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 27 03:50:12.422519 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [req-83e0dd18-f65f-4814-a002-69b816d28ddc req-1bcf14ba-2b9a-41ad-a891-d582b7e81000 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f32a2a3-7d2a-4396-8a34-0ebe6dda5782", "tag": "a1a89af7-a2b7-41f6-9345-9a1eb1e228b0"}]} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:12.424178 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:50:12.424178 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: warnings.warn(msg) May 27 03:50:12.435956 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-6054ed9a-f008-4fe1-ac97-632953b74ab4 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:12.437321 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-6054ed9a-f008-4fe1-ac97-632953b74ab4 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:12.457064 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6054ed9a-f008-4fe1-ac97-632953b74ab4 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:12.457906 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-83e0dd18-f65f-4814-a002-69b816d28ddc req-1bcf14ba-2b9a-41ad-a891-d582b7e81000 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:12.458452 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6054ed9a-f008-4fe1-ac97-632953b74ab4 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:12.459670 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-83e0dd18-f65f-4814-a002-69b816d28ddc req-1bcf14ba-2b9a-41ad-a891-d582b7e81000 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:12.463031 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6054ed9a-f008-4fe1-ac97-632953b74ab4 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:12.463596 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6054ed9a-f008-4fe1-ac97-632953b74ab4 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:12.505211 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.compute.server_external_events [req-83e0dd18-f65f-4814-a002-69b816d28ddc req-1bcf14ba-2b9a-41ad-a891-d582b7e81000 service nova] Creating event network-changed:a1a89af7-a2b7-41f6-9345-9a1eb1e228b0 for instance 8f32a2a3-7d2a-4396-8a34-0ebe6dda5782 on hv-cinder-79326 May 27 03:50:12.517668 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [req-83e0dd18-f65f-4814-a002-69b816d28ddc req-1bcf14ba-2b9a-41ad-a891-d582b7e81000 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098800 May 27 03:50:12.521917 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 562/1182] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:50:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:50:12.609280 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-6054ed9a-f008-4fe1-ac97-632953b74ab4 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action" status: 200 len: 27224 microversion: 2.1 time: 0.177188 May 27 03:50:12.611249 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 621/1183] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:50:12 2021] POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action => generated 27224 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 03:50:12.692107 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-32ed18da-dcf6-4b5e-96dc-4bdb93a00814 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:50:12.693142 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-32ed18da-dcf6-4b5e-96dc-4bdb93a00814 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: 8f32a2a3-7d2a-4396-8a34-0ebe6dda5782] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:12.702158 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-32ed18da-dcf6-4b5e-96dc-4bdb93a00814 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:12.702895 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-32ed18da-dcf6-4b5e-96dc-4bdb93a00814 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:12.703949 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-32ed18da-dcf6-4b5e-96dc-4bdb93a00814 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:12.704860 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-32ed18da-dcf6-4b5e-96dc-4bdb93a00814 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:12.764940 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-83700422-7ecf-4d1c-b13e-f7dcb7060f99 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:12.766933 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-83700422-7ecf-4d1c-b13e-f7dcb7060f99 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:12.777836 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-83700422-7ecf-4d1c-b13e-f7dcb7060f99 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:12.778505 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-83700422-7ecf-4d1c-b13e-f7dcb7060f99 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:12.779450 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-83700422-7ecf-4d1c-b13e-f7dcb7060f99 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:12.780046 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-83700422-7ecf-4d1c-b13e-f7dcb7060f99 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:12.902149 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-83700422-7ecf-4d1c-b13e-f7dcb7060f99 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 200 len: 30725 microversion: 2.20 time: 0.139146 May 27 03:50:12.908500 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 622/1184] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:50:12 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 30725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:50:13.205241 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-32ed18da-dcf6-4b5e-96dc-4bdb93a00814 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fba01f5f17648a7a1fd0fbefd56e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6a582a2a304a7d881efcfa2373dfb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:13.213823 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-32ed18da-dcf6-4b5e-96dc-4bdb93a00814 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/8f32a2a3-7d2a-4396-8a34-0ebe6dda5782" status: 200 len: 1265 microversion: 2.1 time: 0.526767 May 27 03:50:13.223132 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 563/1185] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:50:12 2021] GET /compute/v2.1/servers/8f32a2a3-7d2a-4396-8a34-0ebe6dda5782 => generated 1265 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:50:13.622910 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-4a98eb1c-eb83-4d22-8e76-e5b4f6a6e7ac tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:13.624457 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-4a98eb1c-eb83-4d22-8e76-e5b4f6a6e7ac tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:13.633162 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4a98eb1c-eb83-4d22-8e76-e5b4f6a6e7ac tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:13.633652 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4a98eb1c-eb83-4d22-8e76-e5b4f6a6e7ac tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:13.635211 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4a98eb1c-eb83-4d22-8e76-e5b4f6a6e7ac tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:13.635680 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4a98eb1c-eb83-4d22-8e76-e5b4f6a6e7ac tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:13.776889 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-4a98eb1c-eb83-4d22-8e76-e5b4f6a6e7ac tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action" status: 200 len: 27793 microversion: 2.1 time: 0.154815 May 27 03:50:13.781154 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 623/1186] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:50:13 2021] POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action => generated 27793 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:50:13.915499 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-c32e42fc-528c-4528-8acb-5e89bf22a7f3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:13.916761 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-c32e42fc-528c-4528-8acb-5e89bf22a7f3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:13.923893 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c32e42fc-528c-4528-8acb-5e89bf22a7f3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:13.924345 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c32e42fc-528c-4528-8acb-5e89bf22a7f3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:13.925174 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c32e42fc-528c-4528-8acb-5e89bf22a7f3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:13.925616 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c32e42fc-528c-4528-8acb-5e89bf22a7f3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:14.030411 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-c32e42fc-528c-4528-8acb-5e89bf22a7f3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 200 len: 32349 microversion: 2.20 time: 0.118588 May 27 03:50:14.034814 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 564/1187] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:50:13 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 32349 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:50:14.231167 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-77caf433-f17a-469e-a8eb-b7ad163a030f tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:50:14.231869 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-77caf433-f17a-469e-a8eb-b7ad163a030f tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: 8f32a2a3-7d2a-4396-8a34-0ebe6dda5782] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:14.239712 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-77caf433-f17a-469e-a8eb-b7ad163a030f tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:14.240425 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-77caf433-f17a-469e-a8eb-b7ad163a030f tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:14.241199 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-77caf433-f17a-469e-a8eb-b7ad163a030f tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:14.241640 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-77caf433-f17a-469e-a8eb-b7ad163a030f tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:14.463439 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-77caf433-f17a-469e-a8eb-b7ad163a030f tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fba01f5f17648a7a1fd0fbefd56e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6a582a2a304a7d881efcfa2373dfb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:14.473584 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-77caf433-f17a-469e-a8eb-b7ad163a030f tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/8f32a2a3-7d2a-4396-8a34-0ebe6dda5782" status: 200 len: 1265 microversion: 2.1 time: 0.246547 May 27 03:50:14.474280 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 624/1188] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:50:14 2021] GET /compute/v2.1/servers/8f32a2a3-7d2a-4396-8a34-0ebe6dda5782 => generated 1265 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:50:14.793804 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-f289eee3-2c74-42f1-bccf-e045ceee6511 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:14.796095 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-f289eee3-2c74-42f1-bccf-e045ceee6511 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:14.809940 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f289eee3-2c74-42f1-bccf-e045ceee6511 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:14.810781 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f289eee3-2c74-42f1-bccf-e045ceee6511 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:14.811782 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f289eee3-2c74-42f1-bccf-e045ceee6511 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:14.827971 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f289eee3-2c74-42f1-bccf-e045ceee6511 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:14.933412 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-f289eee3-2c74-42f1-bccf-e045ceee6511 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action" status: 200 len: 28099 microversion: 2.1 time: 0.147215 May 27 03:50:14.934331 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 565/1189] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:50:14 2021] POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action => generated 28099 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 03:50:15.043370 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-7dbe825a-8082-402f-89d0-b8b0fc6aadd3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:15.045074 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-7dbe825a-8082-402f-89d0-b8b0fc6aadd3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:15.053349 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7dbe825a-8082-402f-89d0-b8b0fc6aadd3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:15.054287 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7dbe825a-8082-402f-89d0-b8b0fc6aadd3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:15.055334 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7dbe825a-8082-402f-89d0-b8b0fc6aadd3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:15.056118 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7dbe825a-8082-402f-89d0-b8b0fc6aadd3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:15.169088 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-7dbe825a-8082-402f-89d0-b8b0fc6aadd3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 200 len: 33345 microversion: 2.20 time: 0.129909 May 27 03:50:15.170363 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 625/1190] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:50:15 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 33345 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 27 03:50:15.491356 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-34dfd3bd-3848-4576-87e4-73948cfcc020 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:50:15.492321 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-34dfd3bd-3848-4576-87e4-73948cfcc020 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: 8f32a2a3-7d2a-4396-8a34-0ebe6dda5782] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:15.504581 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-34dfd3bd-3848-4576-87e4-73948cfcc020 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:15.505386 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-34dfd3bd-3848-4576-87e4-73948cfcc020 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:15.506390 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-34dfd3bd-3848-4576-87e4-73948cfcc020 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:15.507042 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-34dfd3bd-3848-4576-87e4-73948cfcc020 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:15.929054 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-34dfd3bd-3848-4576-87e4-73948cfcc020 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fba01f5f17648a7a1fd0fbefd56e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6a582a2a304a7d881efcfa2373dfb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:15.939996 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-34dfd3bd-3848-4576-87e4-73948cfcc020 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/8f32a2a3-7d2a-4396-8a34-0ebe6dda5782" status: 200 len: 1265 microversion: 2.1 time: 0.451246 May 27 03:50:15.941383 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 566/1191] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:50:15 2021] GET /compute/v2.1/servers/8f32a2a3-7d2a-4396-8a34-0ebe6dda5782 => generated 1265 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:50:15.947915 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-cf41130e-d21b-46ca-9d41-ee2bb016e9f5 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:15.952472 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-cf41130e-d21b-46ca-9d41-ee2bb016e9f5 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:15.961312 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-cf41130e-d21b-46ca-9d41-ee2bb016e9f5 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:15.961830 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-cf41130e-d21b-46ca-9d41-ee2bb016e9f5 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:15.962633 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-cf41130e-d21b-46ca-9d41-ee2bb016e9f5 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:15.963074 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-cf41130e-d21b-46ca-9d41-ee2bb016e9f5 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:16.060742 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-cf41130e-d21b-46ca-9d41-ee2bb016e9f5 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action" status: 200 len: 28216 microversion: 2.1 time: 0.118737 May 27 03:50:16.061361 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 626/1192] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:50:15 2021] POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action => generated 28216 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 03:50:16.181371 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-e7ebd967-cedb-49a5-90b4-fa4eb5b3f5db tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:16.182294 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-e7ebd967-cedb-49a5-90b4-fa4eb5b3f5db tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:16.189387 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e7ebd967-cedb-49a5-90b4-fa4eb5b3f5db tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:16.189835 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e7ebd967-cedb-49a5-90b4-fa4eb5b3f5db tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:16.190605 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e7ebd967-cedb-49a5-90b4-fa4eb5b3f5db tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:16.191039 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e7ebd967-cedb-49a5-90b4-fa4eb5b3f5db tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:16.285368 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-e7ebd967-cedb-49a5-90b4-fa4eb5b3f5db tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 200 len: 34612 microversion: 2.20 time: 0.108150 May 27 03:50:16.286002 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 567/1193] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:50:16 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 34612 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:50:16.958316 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-4dc9fc21-5180-4f37-acce-836fb3a38a60 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:50:16.959010 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-4dc9fc21-5180-4f37-acce-836fb3a38a60 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: 8f32a2a3-7d2a-4396-8a34-0ebe6dda5782] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:16.967388 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4dc9fc21-5180-4f37-acce-836fb3a38a60 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:16.967980 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4dc9fc21-5180-4f37-acce-836fb3a38a60 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:16.968774 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4dc9fc21-5180-4f37-acce-836fb3a38a60 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:16.969211 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4dc9fc21-5180-4f37-acce-836fb3a38a60 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:17.072848 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-02233df5-f5b9-4fb0-80ee-9ac52cf9e639 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:17.073900 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-02233df5-f5b9-4fb0-80ee-9ac52cf9e639 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:17.081868 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-02233df5-f5b9-4fb0-80ee-9ac52cf9e639 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:17.082294 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-02233df5-f5b9-4fb0-80ee-9ac52cf9e639 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:17.083077 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-02233df5-f5b9-4fb0-80ee-9ac52cf9e639 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:17.083557 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-02233df5-f5b9-4fb0-80ee-9ac52cf9e639 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:17.168752 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-4dc9fc21-5180-4f37-acce-836fb3a38a60 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fba01f5f17648a7a1fd0fbefd56e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6a582a2a304a7d881efcfa2373dfb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:17.175324 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-4dc9fc21-5180-4f37-acce-836fb3a38a60 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/8f32a2a3-7d2a-4396-8a34-0ebe6dda5782" status: 200 len: 1265 microversion: 2.1 time: 0.220961 May 27 03:50:17.175892 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 627/1194] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:50:16 2021] GET /compute/v2.1/servers/8f32a2a3-7d2a-4396-8a34-0ebe6dda5782 => generated 1265 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:50:17.179360 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-02233df5-f5b9-4fb0-80ee-9ac52cf9e639 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action" status: 200 len: 28216 microversion: 2.1 time: 0.110991 May 27 03:50:17.180993 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 568/1195] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:50:17 2021] POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action => generated 28216 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 03:50:17.298230 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-6a52d869-8100-413d-a085-9788fb6f1778 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:17.299165 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-6a52d869-8100-413d-a085-9788fb6f1778 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:17.307053 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6a52d869-8100-413d-a085-9788fb6f1778 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:17.307502 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6a52d869-8100-413d-a085-9788fb6f1778 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:17.308273 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6a52d869-8100-413d-a085-9788fb6f1778 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:17.308744 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6a52d869-8100-413d-a085-9788fb6f1778 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:17.408097 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-6a52d869-8100-413d-a085-9788fb6f1778 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 200 len: 36166 microversion: 2.20 time: 0.114181 May 27 03:50:17.408599 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 628/1196] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:50:17 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 36166 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:50:18.192933 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-7ee6f111-8df3-41ce-9c52-fee19fe43b0f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:18.193507 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-0372783f-2067-493f-bba0-00e706e18d80 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:50:18.194177 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-7ee6f111-8df3-41ce-9c52-fee19fe43b0f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:18.194285 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-0372783f-2067-493f-bba0-00e706e18d80 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: 8f32a2a3-7d2a-4396-8a34-0ebe6dda5782] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:18.202753 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0372783f-2067-493f-bba0-00e706e18d80 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:18.202973 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-7ee6f111-8df3-41ce-9c52-fee19fe43b0f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:18.203268 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0372783f-2067-493f-bba0-00e706e18d80 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:18.203379 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-7ee6f111-8df3-41ce-9c52-fee19fe43b0f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:18.204007 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0372783f-2067-493f-bba0-00e706e18d80 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:18.204187 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-7ee6f111-8df3-41ce-9c52-fee19fe43b0f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:18.204477 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0372783f-2067-493f-bba0-00e706e18d80 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:18.204682 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-7ee6f111-8df3-41ce-9c52-fee19fe43b0f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:18.311719 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-7ee6f111-8df3-41ce-9c52-fee19fe43b0f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action" status: 200 len: 28216 microversion: 2.1 time: 0.122881 May 27 03:50:18.312296 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 569/1197] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:50:18 2021] POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action => generated 28216 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:50:18.409043 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-0372783f-2067-493f-bba0-00e706e18d80 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fba01f5f17648a7a1fd0fbefd56e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6a582a2a304a7d881efcfa2373dfb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:18.417481 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-0372783f-2067-493f-bba0-00e706e18d80 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/8f32a2a3-7d2a-4396-8a34-0ebe6dda5782" status: 200 len: 1265 microversion: 2.1 time: 0.228386 May 27 03:50:18.418039 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 629/1198] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:50:18 2021] GET /compute/v2.1/servers/8f32a2a3-7d2a-4396-8a34-0ebe6dda5782 => generated 1265 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:50:18.420235 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-85d847b1-1669-4b45-af29-9c3619d5f3b8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:18.420833 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-85d847b1-1669-4b45-af29-9c3619d5f3b8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:18.428665 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-85d847b1-1669-4b45-af29-9c3619d5f3b8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:18.429125 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-85d847b1-1669-4b45-af29-9c3619d5f3b8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:18.429897 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-85d847b1-1669-4b45-af29-9c3619d5f3b8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:18.430341 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-85d847b1-1669-4b45-af29-9c3619d5f3b8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:18.528788 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-85d847b1-1669-4b45-af29-9c3619d5f3b8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 200 len: 37919 microversion: 2.20 time: 0.113051 May 27 03:50:18.529525 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 570/1199] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:50:18 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 37919 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 27 03:50:19.323421 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-917bfb35-1e42-41a5-bcf3-80456aec9802 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:19.324345 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-917bfb35-1e42-41a5-bcf3-80456aec9802 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:19.336142 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-917bfb35-1e42-41a5-bcf3-80456aec9802 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:19.337128 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-917bfb35-1e42-41a5-bcf3-80456aec9802 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:19.337885 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-917bfb35-1e42-41a5-bcf3-80456aec9802 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:19.338318 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-917bfb35-1e42-41a5-bcf3-80456aec9802 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:19.435290 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-125b2ccd-c9ad-48dd-9fd9-9a7d692d9598 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:50:19.435992 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-125b2ccd-c9ad-48dd-9fd9-9a7d692d9598 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: 8f32a2a3-7d2a-4396-8a34-0ebe6dda5782] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:19.439518 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-917bfb35-1e42-41a5-bcf3-80456aec9802 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action" status: 200 len: 28216 microversion: 2.1 time: 0.119731 May 27 03:50:19.440560 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 630/1200] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:50:19 2021] POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action => generated 28216 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:50:19.444006 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-125b2ccd-c9ad-48dd-9fd9-9a7d692d9598 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:19.444523 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-125b2ccd-c9ad-48dd-9fd9-9a7d692d9598 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:19.447730 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-125b2ccd-c9ad-48dd-9fd9-9a7d692d9598 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:19.447730 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-125b2ccd-c9ad-48dd-9fd9-9a7d692d9598 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:19.542029 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-db316629-6e98-476a-9e10-f05b87c9d814 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:19.543028 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-db316629-6e98-476a-9e10-f05b87c9d814 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:19.550805 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-db316629-6e98-476a-9e10-f05b87c9d814 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:19.551248 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-db316629-6e98-476a-9e10-f05b87c9d814 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:19.552013 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-db316629-6e98-476a-9e10-f05b87c9d814 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:19.552465 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-db316629-6e98-476a-9e10-f05b87c9d814 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:19.646562 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-125b2ccd-c9ad-48dd-9fd9-9a7d692d9598 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fba01f5f17648a7a1fd0fbefd56e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6a582a2a304a7d881efcfa2373dfb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:19.646562 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-125b2ccd-c9ad-48dd-9fd9-9a7d692d9598 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/8f32a2a3-7d2a-4396-8a34-0ebe6dda5782" status: 200 len: 1265 microversion: 2.1 time: 0.214932 May 27 03:50:19.647098 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 571/1201] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:50:19 2021] GET /compute/v2.1/servers/8f32a2a3-7d2a-4396-8a34-0ebe6dda5782 => generated 1265 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:50:19.666171 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-db316629-6e98-476a-9e10-f05b87c9d814 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 200 len: 38237 microversion: 2.20 time: 0.128711 May 27 03:50:19.666834 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 631/1202] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:50:19 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 38237 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 27 03:50:20.451641 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-c23ed5dc-43eb-407a-b4d2-6952bd842cae tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:20.452591 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-c23ed5dc-43eb-407a-b4d2-6952bd842cae tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:20.460152 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c23ed5dc-43eb-407a-b4d2-6952bd842cae tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:20.460834 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c23ed5dc-43eb-407a-b4d2-6952bd842cae tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:20.461555 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c23ed5dc-43eb-407a-b4d2-6952bd842cae tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:20.461990 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c23ed5dc-43eb-407a-b4d2-6952bd842cae tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:20.611070 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-c23ed5dc-43eb-407a-b4d2-6952bd842cae tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action" status: 200 len: 28216 microversion: 2.1 time: 0.162992 May 27 03:50:20.611750 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 572/1203] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:50:20 2021] POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action => generated 28216 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:50:20.663128 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-c450f5c4-dedc-415b-86e3-83ac877db10d tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:50:20.663830 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-c450f5c4-dedc-415b-86e3-83ac877db10d tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: 8f32a2a3-7d2a-4396-8a34-0ebe6dda5782] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:20.672208 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c450f5c4-dedc-415b-86e3-83ac877db10d tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:20.672921 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c450f5c4-dedc-415b-86e3-83ac877db10d tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:20.673461 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c450f5c4-dedc-415b-86e3-83ac877db10d tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:20.673899 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c450f5c4-dedc-415b-86e3-83ac877db10d tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:20.678294 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-3104c2f1-dc8c-402c-b04a-116975886467 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:20.679330 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-3104c2f1-dc8c-402c-b04a-116975886467 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:20.687663 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-3104c2f1-dc8c-402c-b04a-116975886467 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:20.688114 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-3104c2f1-dc8c-402c-b04a-116975886467 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:20.688914 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-3104c2f1-dc8c-402c-b04a-116975886467 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:20.689356 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-3104c2f1-dc8c-402c-b04a-116975886467 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:20.781534 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-3104c2f1-dc8c-402c-b04a-116975886467 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 200 len: 38237 microversion: 2.20 time: 0.106820 May 27 03:50:20.782539 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 573/1204] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:50:20 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 38237 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 27 03:50:20.868242 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-c450f5c4-dedc-415b-86e3-83ac877db10d tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fba01f5f17648a7a1fd0fbefd56e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6a582a2a304a7d881efcfa2373dfb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:20.876291 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-c450f5c4-dedc-415b-86e3-83ac877db10d tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/8f32a2a3-7d2a-4396-8a34-0ebe6dda5782" status: 200 len: 1265 microversion: 2.1 time: 0.217213 May 27 03:50:20.876882 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 632/1205] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:50:20 2021] GET /compute/v2.1/servers/8f32a2a3-7d2a-4396-8a34-0ebe6dda5782 => generated 1265 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:50:21.623964 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-f6501e45-4257-488f-abb9-7645cab6d0a4 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:21.625000 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-f6501e45-4257-488f-abb9-7645cab6d0a4 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:21.632924 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f6501e45-4257-488f-abb9-7645cab6d0a4 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:21.634069 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f6501e45-4257-488f-abb9-7645cab6d0a4 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:21.634839 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f6501e45-4257-488f-abb9-7645cab6d0a4 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:21.635280 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f6501e45-4257-488f-abb9-7645cab6d0a4 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:21.727373 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-f6501e45-4257-488f-abb9-7645cab6d0a4 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action" status: 200 len: 28216 microversion: 2.1 time: 0.107439 May 27 03:50:21.727902 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 574/1206] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:50:21 2021] POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action => generated 28216 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:50:21.793365 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-60b6985b-c263-4246-ab52-e49dafe9d7ce tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:21.794297 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-60b6985b-c263-4246-ab52-e49dafe9d7ce tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:21.801909 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-60b6985b-c263-4246-ab52-e49dafe9d7ce tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:21.802358 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-60b6985b-c263-4246-ab52-e49dafe9d7ce tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:21.803124 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-60b6985b-c263-4246-ab52-e49dafe9d7ce tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:21.803561 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-60b6985b-c263-4246-ab52-e49dafe9d7ce tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:21.893093 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-1b9cd428-2b98-4c75-959c-d2ceb0f4b1ef tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:50:21.893797 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-1b9cd428-2b98-4c75-959c-d2ceb0f4b1ef tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: 8f32a2a3-7d2a-4396-8a34-0ebe6dda5782] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:21.901672 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1b9cd428-2b98-4c75-959c-d2ceb0f4b1ef tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:21.902126 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1b9cd428-2b98-4c75-959c-d2ceb0f4b1ef tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:21.902897 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1b9cd428-2b98-4c75-959c-d2ceb0f4b1ef tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:21.903336 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1b9cd428-2b98-4c75-959c-d2ceb0f4b1ef tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:21.904599 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-60b6985b-c263-4246-ab52-e49dafe9d7ce tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 200 len: 38237 microversion: 2.20 time: 0.114711 May 27 03:50:21.908951 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 633/1207] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:50:21 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 38237 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 27 03:50:22.101614 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-1b9cd428-2b98-4c75-959c-d2ceb0f4b1ef tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fba01f5f17648a7a1fd0fbefd56e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6a582a2a304a7d881efcfa2373dfb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:22.110218 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-1b9cd428-2b98-4c75-959c-d2ceb0f4b1ef tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/8f32a2a3-7d2a-4396-8a34-0ebe6dda5782" status: 200 len: 1265 microversion: 2.1 time: 0.221153 May 27 03:50:22.110777 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 575/1208] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:50:21 2021] GET /compute/v2.1/servers/8f32a2a3-7d2a-4396-8a34-0ebe6dda5782 => generated 1265 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:50:22.739622 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-1a635135-c156-4edc-9398-81277c0f3625 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:22.740675 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-1a635135-c156-4edc-9398-81277c0f3625 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:22.748620 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1a635135-c156-4edc-9398-81277c0f3625 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:22.749074 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1a635135-c156-4edc-9398-81277c0f3625 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:22.749851 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1a635135-c156-4edc-9398-81277c0f3625 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:22.750296 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1a635135-c156-4edc-9398-81277c0f3625 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:22.848730 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-1a635135-c156-4edc-9398-81277c0f3625 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action" status: 200 len: 28216 microversion: 2.1 time: 0.113012 May 27 03:50:22.849384 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 634/1209] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:50:22 2021] POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action => generated 28216 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:50:22.916138 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-2afc9489-6930-4a03-babb-aef848c24462 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:22.917118 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-2afc9489-6930-4a03-babb-aef848c24462 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:22.924835 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2afc9489-6930-4a03-babb-aef848c24462 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:22.925293 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2afc9489-6930-4a03-babb-aef848c24462 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:22.926062 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2afc9489-6930-4a03-babb-aef848c24462 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:22.926502 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2afc9489-6930-4a03-babb-aef848c24462 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:23.018975 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-2afc9489-6930-4a03-babb-aef848c24462 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 200 len: 38247 microversion: 2.20 time: 0.106441 May 27 03:50:23.019846 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 576/1210] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:50:22 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 38247 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:50:23.127345 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-21cc8943-1647-405f-b52c-90b01791fbaf tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:50:23.128036 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-21cc8943-1647-405f-b52c-90b01791fbaf tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: 8f32a2a3-7d2a-4396-8a34-0ebe6dda5782] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:23.136488 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-21cc8943-1647-405f-b52c-90b01791fbaf tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:23.136941 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-21cc8943-1647-405f-b52c-90b01791fbaf tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:23.137699 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-21cc8943-1647-405f-b52c-90b01791fbaf tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:23.138141 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-21cc8943-1647-405f-b52c-90b01791fbaf tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:23.338456 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-21cc8943-1647-405f-b52c-90b01791fbaf tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fba01f5f17648a7a1fd0fbefd56e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6a582a2a304a7d881efcfa2373dfb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:23.346987 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-21cc8943-1647-405f-b52c-90b01791fbaf tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/8f32a2a3-7d2a-4396-8a34-0ebe6dda5782" status: 200 len: 1265 microversion: 2.1 time: 0.223670 May 27 03:50:23.347558 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 635/1211] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:50:23 2021] GET /compute/v2.1/servers/8f32a2a3-7d2a-4396-8a34-0ebe6dda5782 => generated 1265 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:50:23.861321 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-505f1112-2b8a-4aa6-b62b-4f271ed3c434 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:23.862430 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-505f1112-2b8a-4aa6-b62b-4f271ed3c434 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:23.870310 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-505f1112-2b8a-4aa6-b62b-4f271ed3c434 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:23.870759 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-505f1112-2b8a-4aa6-b62b-4f271ed3c434 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:23.871527 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-505f1112-2b8a-4aa6-b62b-4f271ed3c434 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:23.871971 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-505f1112-2b8a-4aa6-b62b-4f271ed3c434 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:23.965365 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-505f1112-2b8a-4aa6-b62b-4f271ed3c434 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action" status: 200 len: 28216 microversion: 2.1 time: 0.108026 May 27 03:50:23.966067 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 577/1212] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:50:23 2021] POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action => generated 28216 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:50:24.031215 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-1b9cc889-6b02-40c2-aa6e-dfd96088cc92 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:24.032058 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-1b9cc889-6b02-40c2-aa6e-dfd96088cc92 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:24.040146 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1b9cc889-6b02-40c2-aa6e-dfd96088cc92 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:24.040678 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1b9cc889-6b02-40c2-aa6e-dfd96088cc92 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:24.041463 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1b9cc889-6b02-40c2-aa6e-dfd96088cc92 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:24.041904 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1b9cc889-6b02-40c2-aa6e-dfd96088cc92 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:24.132298 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-1b9cc889-6b02-40c2-aa6e-dfd96088cc92 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 200 len: 38378 microversion: 2.20 time: 0.105001 May 27 03:50:24.132969 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 636/1213] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:50:24 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 38378 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 27 03:50:24.143262 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-e97c34e8-1988-48eb-8ad8-36529608e4cb tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:50:24.143842 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-e97c34e8-1988-48eb-8ad8-36529608e4cb tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:24.152522 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e97c34e8-1988-48eb-8ad8-36529608e4cb tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:24.152983 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e97c34e8-1988-48eb-8ad8-36529608e4cb tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:24.153757 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e97c34e8-1988-48eb-8ad8-36529608e4cb tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:24.154202 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e97c34e8-1988-48eb-8ad8-36529608e4cb tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:24.213194 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-e97c34e8-1988-48eb-8ad8-36529608e4cb tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/ips" status: 200 len: 151 microversion: 2.20 time: 0.073993 May 27 03:50:24.213772 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 578/1214] 10.222.0.25 () {60 vars in 1289 bytes} [Thu May 27 03:50:24 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/ips => generated 151 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:50:24.363566 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-7f02e07f-7233-4ef1-adf7-5daf344efeec tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:50:24.364273 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-7f02e07f-7233-4ef1-adf7-5daf344efeec tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: 8f32a2a3-7d2a-4396-8a34-0ebe6dda5782] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:24.372150 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7f02e07f-7233-4ef1-adf7-5daf344efeec tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:24.372657 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7f02e07f-7233-4ef1-adf7-5daf344efeec tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:24.373498 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7f02e07f-7233-4ef1-adf7-5daf344efeec tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:24.373939 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7f02e07f-7233-4ef1-adf7-5daf344efeec tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:24.567028 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-7f02e07f-7233-4ef1-adf7-5daf344efeec tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fba01f5f17648a7a1fd0fbefd56e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6a582a2a304a7d881efcfa2373dfb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:24.575859 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-7f02e07f-7233-4ef1-adf7-5daf344efeec tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/8f32a2a3-7d2a-4396-8a34-0ebe6dda5782" status: 200 len: 1265 microversion: 2.1 time: 0.216422 May 27 03:50:24.576451 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 637/1215] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:50:24 2021] GET /compute/v2.1/servers/8f32a2a3-7d2a-4396-8a34-0ebe6dda5782 => generated 1265 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:50:24.977630 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-1503e717-4e9f-4c72-ac9b-ab0e7f7f37e6 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:24.978559 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-1503e717-4e9f-4c72-ac9b-ab0e7f7f37e6 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:24.985847 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1503e717-4e9f-4c72-ac9b-ab0e7f7f37e6 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:24.986338 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1503e717-4e9f-4c72-ac9b-ab0e7f7f37e6 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:24.987105 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1503e717-4e9f-4c72-ac9b-ab0e7f7f37e6 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:24.987546 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1503e717-4e9f-4c72-ac9b-ab0e7f7f37e6 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:25.117145 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-1503e717-4e9f-4c72-ac9b-ab0e7f7f37e6 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action" status: 200 len: 28216 microversion: 2.1 time: 0.143459 May 27 03:50:25.118263 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 579/1216] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:50:24 2021] POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action => generated 28216 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:50:25.426878 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [req-0d95a9d3-2c31-4bf1-ab8e-2632842fd27c req-b6674544-7995-4666-8e63-12c47be4e621 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f32a2a3-7d2a-4396-8a34-0ebe6dda5782", "name": "network-vif-plugged", "status": "completed", "tag": "a1a89af7-a2b7-41f6-9345-9a1eb1e228b0"}]} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:25.426878 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:50:25.426878 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: warnings.warn(msg) May 27 03:50:25.435243 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-0d95a9d3-2c31-4bf1-ab8e-2632842fd27c req-b6674544-7995-4666-8e63-12c47be4e621 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:25.435686 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-0d95a9d3-2c31-4bf1-ab8e-2632842fd27c req-b6674544-7995-4666-8e63-12c47be4e621 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:25.454731 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.compute.server_external_events [req-0d95a9d3-2c31-4bf1-ab8e-2632842fd27c req-b6674544-7995-4666-8e63-12c47be4e621 service nova] Creating event network-vif-plugged:a1a89af7-a2b7-41f6-9345-9a1eb1e228b0 for instance 8f32a2a3-7d2a-4396-8a34-0ebe6dda5782 on hv-cinder-79326 May 27 03:50:25.459488 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [req-0d95a9d3-2c31-4bf1-ab8e-2632842fd27c req-b6674544-7995-4666-8e63-12c47be4e621 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039875 May 27 03:50:25.460072 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 638/1217] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:50:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:50:25.593497 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-ebc4d83b-0033-45ee-89c8-0c5213de168a tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:50:25.594296 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-ebc4d83b-0033-45ee-89c8-0c5213de168a tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: 8f32a2a3-7d2a-4396-8a34-0ebe6dda5782] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:25.603022 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ebc4d83b-0033-45ee-89c8-0c5213de168a tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:25.603424 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ebc4d83b-0033-45ee-89c8-0c5213de168a tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:25.604199 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ebc4d83b-0033-45ee-89c8-0c5213de168a tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:25.604676 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ebc4d83b-0033-45ee-89c8-0c5213de168a tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:25.835251 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-ebc4d83b-0033-45ee-89c8-0c5213de168a tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fba01f5f17648a7a1fd0fbefd56e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6a582a2a304a7d881efcfa2373dfb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:25.844678 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-ebc4d83b-0033-45ee-89c8-0c5213de168a tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/8f32a2a3-7d2a-4396-8a34-0ebe6dda5782" status: 200 len: 1265 microversion: 2.1 time: 0.255214 May 27 03:50:25.845265 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 580/1218] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:50:25 2021] GET /compute/v2.1/servers/8f32a2a3-7d2a-4396-8a34-0ebe6dda5782 => generated 1265 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:50:26.129687 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-335653e2-5ecd-4e93-a584-bdbec9b804c0 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:26.130710 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-335653e2-5ecd-4e93-a584-bdbec9b804c0 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:26.138821 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-335653e2-5ecd-4e93-a584-bdbec9b804c0 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:26.139277 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-335653e2-5ecd-4e93-a584-bdbec9b804c0 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:26.140058 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-335653e2-5ecd-4e93-a584-bdbec9b804c0 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:26.140523 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-335653e2-5ecd-4e93-a584-bdbec9b804c0 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:26.236383 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-335653e2-5ecd-4e93-a584-bdbec9b804c0 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action" status: 200 len: 28216 microversion: 2.1 time: 0.110655 May 27 03:50:26.237229 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 639/1219] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:50:26 2021] POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action => generated 28216 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:50:26.861163 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-06180869-2ad4-4bae-9d85-e606cc55f1e2 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:50:26.861781 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-06180869-2ad4-4bae-9d85-e606cc55f1e2 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: 8f32a2a3-7d2a-4396-8a34-0ebe6dda5782] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:26.869634 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-06180869-2ad4-4bae-9d85-e606cc55f1e2 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:26.870093 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-06180869-2ad4-4bae-9d85-e606cc55f1e2 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:26.870872 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-06180869-2ad4-4bae-9d85-e606cc55f1e2 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:26.871315 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-06180869-2ad4-4bae-9d85-e606cc55f1e2 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:26.976596 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-8ea3cbbf-5a39-4e45-8acc-728ea166c2c8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:26.977884 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-8ea3cbbf-5a39-4e45-8acc-728ea166c2c8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:26.985863 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8ea3cbbf-5a39-4e45-8acc-728ea166c2c8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:26.986322 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8ea3cbbf-5a39-4e45-8acc-728ea166c2c8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:26.987104 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8ea3cbbf-5a39-4e45-8acc-728ea166c2c8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:26.987549 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8ea3cbbf-5a39-4e45-8acc-728ea166c2c8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:27.043933 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.objects.instance [None req-8ea3cbbf-5a39-4e45-8acc-728ea166c2c8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lazy-loading 'flavor' on Instance uuid aaf24d29-a180-44ed-9549-e4cca130f813 {{(pid=113020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 27 03:50:27.068604 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-06180869-2ad4-4bae-9d85-e606cc55f1e2 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fba01f5f17648a7a1fd0fbefd56e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6a582a2a304a7d881efcfa2373dfb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:27.078450 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-06180869-2ad4-4bae-9d85-e606cc55f1e2 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/8f32a2a3-7d2a-4396-8a34-0ebe6dda5782" status: 200 len: 1265 microversion: 2.1 time: 0.220651 May 27 03:50:27.079217 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 581/1220] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:50:26 2021] GET /compute/v2.1/servers/8f32a2a3-7d2a-4396-8a34-0ebe6dda5782 => generated 1265 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:50:27.248212 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-0bf96c78-06c9-4c54-a8cd-cbd07f2b3778 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:27.249283 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-0bf96c78-06c9-4c54-a8cd-cbd07f2b3778 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:27.256492 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-0bf96c78-06c9-4c54-a8cd-cbd07f2b3778 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:27.256947 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-0bf96c78-06c9-4c54-a8cd-cbd07f2b3778 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:27.257705 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-0bf96c78-06c9-4c54-a8cd-cbd07f2b3778 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:27.258630 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-0bf96c78-06c9-4c54-a8cd-cbd07f2b3778 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:27.359432 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-0bf96c78-06c9-4c54-a8cd-cbd07f2b3778 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action" status: 200 len: 28216 microversion: 2.1 time: 0.114632 May 27 03:50:27.360177 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 582/1221] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:50:27 2021] POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action => generated 28216 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 03:50:27.621473 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-8ea3cbbf-5a39-4e45-8acc-728ea166c2c8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 202 len: 0 microversion: 2.20 time: 0.648832 May 27 03:50:27.622038 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 640/1222] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:50:26 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 0 bytes in 651 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 27 03:50:27.630634 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-2597168e-f055-44ed-8e2f-43fb24566c09 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:50:27.631343 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-2597168e-f055-44ed-8e2f-43fb24566c09 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:27.639750 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2597168e-f055-44ed-8e2f-43fb24566c09 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:27.640209 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2597168e-f055-44ed-8e2f-43fb24566c09 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:27.641028 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2597168e-f055-44ed-8e2f-43fb24566c09 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:27.641474 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2597168e-f055-44ed-8e2f-43fb24566c09 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:27.844337 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-2597168e-f055-44ed-8e2f-43fb24566c09 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:27.853194 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-2597168e-f055-44ed-8e2f-43fb24566c09 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:27.854733 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-2597168e-f055-44ed-8e2f-43fb24566c09 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:27.855874 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-2597168e-f055-44ed-8e2f-43fb24566c09 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 200 len: 1723 microversion: 2.20 time: 0.229439 May 27 03:50:27.856451 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 583/1223] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:50:27 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 1723 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:50:28.096340 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-5cd5ef96-2f16-462f-9891-5e8bc7a281b7 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:50:28.097058 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-5cd5ef96-2f16-462f-9891-5e8bc7a281b7 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: 8f32a2a3-7d2a-4396-8a34-0ebe6dda5782] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:28.105083 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-5cd5ef96-2f16-462f-9891-5e8bc7a281b7 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:28.105529 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-5cd5ef96-2f16-462f-9891-5e8bc7a281b7 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:28.106286 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-5cd5ef96-2f16-462f-9891-5e8bc7a281b7 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:28.106918 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-5cd5ef96-2f16-462f-9891-5e8bc7a281b7 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:28.371013 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-7e6619ee-d944-4de3-9fca-c85e00c240a7 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:28.371932 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-7e6619ee-d944-4de3-9fca-c85e00c240a7 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:28.379006 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-7e6619ee-d944-4de3-9fca-c85e00c240a7 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:28.379454 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-7e6619ee-d944-4de3-9fca-c85e00c240a7 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:28.380222 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-7e6619ee-d944-4de3-9fca-c85e00c240a7 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:28.380700 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-7e6619ee-d944-4de3-9fca-c85e00c240a7 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:28.387232 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-5cd5ef96-2f16-462f-9891-5e8bc7a281b7 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fba01f5f17648a7a1fd0fbefd56e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6a582a2a304a7d881efcfa2373dfb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:28.395409 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-5cd5ef96-2f16-462f-9891-5e8bc7a281b7 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/8f32a2a3-7d2a-4396-8a34-0ebe6dda5782" status: 200 len: 1451 microversion: 2.1 time: 0.303605 May 27 03:50:28.395966 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 641/1224] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:50:28 2021] GET /compute/v2.1/servers/8f32a2a3-7d2a-4396-8a34-0ebe6dda5782 => generated 1451 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:50:28.411198 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-43dbf56d-5682-4940-ab1b-d3e60a30cb7a tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:50:28.411885 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-43dbf56d-5682-4940-ab1b-d3e60a30cb7a tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: 8f32a2a3-7d2a-4396-8a34-0ebe6dda5782] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:28.419419 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-43dbf56d-5682-4940-ab1b-d3e60a30cb7a tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:28.436011 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-43dbf56d-5682-4940-ab1b-d3e60a30cb7a tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:28.436011 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-43dbf56d-5682-4940-ab1b-d3e60a30cb7a tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:28.436011 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-43dbf56d-5682-4940-ab1b-d3e60a30cb7a tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:28.476341 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-7e6619ee-d944-4de3-9fca-c85e00c240a7 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action" status: 200 len: 28216 microversion: 2.1 time: 0.108860 May 27 03:50:28.477602 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 584/1225] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:50:28 2021] POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action => generated 28216 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 03:50:28.615252 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-43dbf56d-5682-4940-ab1b-d3e60a30cb7a tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fba01f5f17648a7a1fd0fbefd56e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6a582a2a304a7d881efcfa2373dfb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:28.623390 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-43dbf56d-5682-4940-ab1b-d3e60a30cb7a tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/8f32a2a3-7d2a-4396-8a34-0ebe6dda5782" status: 200 len: 1451 microversion: 2.1 time: 0.215569 May 27 03:50:28.623987 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 642/1226] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:50:28 2021] GET /compute/v2.1/servers/8f32a2a3-7d2a-4396-8a34-0ebe6dda5782 => generated 1451 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:50:28.874779 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-c040e38e-aa53-4794-800c-3cd9ef4cc654 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:50:28.875408 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-c040e38e-aa53-4794-800c-3cd9ef4cc654 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:28.883856 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c040e38e-aa53-4794-800c-3cd9ef4cc654 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:28.884311 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c040e38e-aa53-4794-800c-3cd9ef4cc654 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:28.885173 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c040e38e-aa53-4794-800c-3cd9ef4cc654 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:28.885701 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c040e38e-aa53-4794-800c-3cd9ef4cc654 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:29.085866 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-c040e38e-aa53-4794-800c-3cd9ef4cc654 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:29.095094 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-c040e38e-aa53-4794-800c-3cd9ef4cc654 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:29.096650 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-c040e38e-aa53-4794-800c-3cd9ef4cc654 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:29.097776 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-c040e38e-aa53-4794-800c-3cd9ef4cc654 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 200 len: 1723 microversion: 2.20 time: 0.227245 May 27 03:50:29.098319 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 585/1227] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:50:28 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 1723 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:50:29.488839 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-6e72b477-4b4b-4588-bb5c-6cd92217b02e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:29.489933 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-6e72b477-4b4b-4588-bb5c-6cd92217b02e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:29.497850 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6e72b477-4b4b-4588-bb5c-6cd92217b02e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:29.505049 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6e72b477-4b4b-4588-bb5c-6cd92217b02e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:29.505049 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6e72b477-4b4b-4588-bb5c-6cd92217b02e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:29.505049 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6e72b477-4b4b-4588-bb5c-6cd92217b02e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:29.595138 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-6e72b477-4b4b-4588-bb5c-6cd92217b02e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action" status: 200 len: 28505 microversion: 2.1 time: 0.109760 May 27 03:50:29.595779 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 643/1228] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:50:29 2021] POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action => generated 28505 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:50:30.117200 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-f5a9e842-b918-4d51-91a4-7904c75aa206 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:50:30.117835 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-f5a9e842-b918-4d51-91a4-7904c75aa206 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:30.125470 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f5a9e842-b918-4d51-91a4-7904c75aa206 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:30.125923 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f5a9e842-b918-4d51-91a4-7904c75aa206 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:30.126700 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f5a9e842-b918-4d51-91a4-7904c75aa206 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:30.127149 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f5a9e842-b918-4d51-91a4-7904c75aa206 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:30.324055 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-f5a9e842-b918-4d51-91a4-7904c75aa206 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:30.333561 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-f5a9e842-b918-4d51-91a4-7904c75aa206 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:30.335158 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-f5a9e842-b918-4d51-91a4-7904c75aa206 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:30.336890 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-f5a9e842-b918-4d51-91a4-7904c75aa206 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 200 len: 1723 microversion: 2.20 time: 0.222851 May 27 03:50:30.337612 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 586/1229] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:50:30 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:50:30.607842 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-520851fa-515c-47ed-ba93-ea0dc8fbf024 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:30.609058 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-520851fa-515c-47ed-ba93-ea0dc8fbf024 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:30.617926 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-520851fa-515c-47ed-ba93-ea0dc8fbf024 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:30.618417 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-520851fa-515c-47ed-ba93-ea0dc8fbf024 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:30.619212 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-520851fa-515c-47ed-ba93-ea0dc8fbf024 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:30.619656 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-520851fa-515c-47ed-ba93-ea0dc8fbf024 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:30.723266 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-520851fa-515c-47ed-ba93-ea0dc8fbf024 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action" status: 200 len: 28507 microversion: 2.1 time: 0.119629 May 27 03:50:30.723834 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 644/1230] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:50:30 2021] POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action => generated 28507 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 03:50:31.354889 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-829558f3-0a8a-4200-a595-4db099f4da0a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:50:31.355717 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-829558f3-0a8a-4200-a595-4db099f4da0a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:31.363048 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-829558f3-0a8a-4200-a595-4db099f4da0a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:31.363501 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-829558f3-0a8a-4200-a595-4db099f4da0a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:31.364278 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-829558f3-0a8a-4200-a595-4db099f4da0a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:31.364746 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-829558f3-0a8a-4200-a595-4db099f4da0a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:31.548445 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [req-d06171d3-38b1-4f68-b3f7-8c5dc1070b34 req-45dc1ed8-6c59-4ef2-9947-c96a57bf8e30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f32a2a3-7d2a-4396-8a34-0ebe6dda5782", "tag": "a1a89af7-a2b7-41f6-9345-9a1eb1e228b0"}]} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:31.550342 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:50:31.550342 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: warnings.warn(msg) May 27 03:50:31.560146 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-d06171d3-38b1-4f68-b3f7-8c5dc1070b34 req-45dc1ed8-6c59-4ef2-9947-c96a57bf8e30 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:31.560834 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-d06171d3-38b1-4f68-b3f7-8c5dc1070b34 req-45dc1ed8-6c59-4ef2-9947-c96a57bf8e30 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:31.575011 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-829558f3-0a8a-4200-a595-4db099f4da0a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:31.577196 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.compute.server_external_events [req-d06171d3-38b1-4f68-b3f7-8c5dc1070b34 req-45dc1ed8-6c59-4ef2-9947-c96a57bf8e30 service nova] Creating event network-changed:a1a89af7-a2b7-41f6-9345-9a1eb1e228b0 for instance 8f32a2a3-7d2a-4396-8a34-0ebe6dda5782 on hv-cinder-79326 May 27 03:50:31.582022 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [req-d06171d3-38b1-4f68-b3f7-8c5dc1070b34 req-45dc1ed8-6c59-4ef2-9947-c96a57bf8e30 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037507 May 27 03:50:31.582878 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 645/1231] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:50:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:50:31.585757 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-829558f3-0a8a-4200-a595-4db099f4da0a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:31.587844 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-829558f3-0a8a-4200-a595-4db099f4da0a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:31.589129 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-829558f3-0a8a-4200-a595-4db099f4da0a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 200 len: 1723 microversion: 2.20 time: 0.238501 May 27 03:50:31.609070 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 587/1232] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:50:31 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 1723 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:50:31.735905 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-0e7710e4-d72d-4d28-9689-8dff89fe3ead tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:31.737104 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-0e7710e4-d72d-4d28-9689-8dff89fe3ead tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:31.744984 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0e7710e4-d72d-4d28-9689-8dff89fe3ead tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:31.745447 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0e7710e4-d72d-4d28-9689-8dff89fe3ead tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:31.746334 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0e7710e4-d72d-4d28-9689-8dff89fe3ead tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:31.746909 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0e7710e4-d72d-4d28-9689-8dff89fe3ead tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:31.847889 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-0e7710e4-d72d-4d28-9689-8dff89fe3ead tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action" status: 200 len: 28675 microversion: 2.1 time: 0.116020 May 27 03:50:31.851850 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 646/1233] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:50:31 2021] POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action => generated 28675 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 03:50:32.616238 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-6684713b-a057-4e2f-b2d8-aa610eae6123 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:50:32.616876 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-6684713b-a057-4e2f-b2d8-aa610eae6123 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:32.625125 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6684713b-a057-4e2f-b2d8-aa610eae6123 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:32.625573 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6684713b-a057-4e2f-b2d8-aa610eae6123 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:32.626339 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6684713b-a057-4e2f-b2d8-aa610eae6123 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:32.626770 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6684713b-a057-4e2f-b2d8-aa610eae6123 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:32.829546 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-6684713b-a057-4e2f-b2d8-aa610eae6123 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:32.838882 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-6684713b-a057-4e2f-b2d8-aa610eae6123 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:32.840483 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-6684713b-a057-4e2f-b2d8-aa610eae6123 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:32.841618 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-6684713b-a057-4e2f-b2d8-aa610eae6123 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 200 len: 1723 microversion: 2.20 time: 0.229158 May 27 03:50:32.842167 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 588/1234] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:50:32 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 1723 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:50:32.859633 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-4955617a-f5e9-48f2-b98e-5b5c522fcbef tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:32.860704 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-4955617a-f5e9-48f2-b98e-5b5c522fcbef tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:32.868805 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4955617a-f5e9-48f2-b98e-5b5c522fcbef tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:32.869276 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4955617a-f5e9-48f2-b98e-5b5c522fcbef tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:32.870073 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4955617a-f5e9-48f2-b98e-5b5c522fcbef tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:32.870511 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4955617a-f5e9-48f2-b98e-5b5c522fcbef tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:32.961848 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-4955617a-f5e9-48f2-b98e-5b5c522fcbef tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action" status: 200 len: 28675 microversion: 2.1 time: 0.105611 May 27 03:50:32.965638 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 647/1235] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:50:32 2021] POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action => generated 28675 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:50:33.860746 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-e29f041c-0cc1-4c19-b2ee-2a1d440868e4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:50:33.862364 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-e29f041c-0cc1-4c19-b2ee-2a1d440868e4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:33.869437 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e29f041c-0cc1-4c19-b2ee-2a1d440868e4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:33.869898 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e29f041c-0cc1-4c19-b2ee-2a1d440868e4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:33.870703 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e29f041c-0cc1-4c19-b2ee-2a1d440868e4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:33.871146 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e29f041c-0cc1-4c19-b2ee-2a1d440868e4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:33.973836 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-ac4acc56-6fe0-4fcb-8237-dc231a84fbd0 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:33.974892 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-ac4acc56-6fe0-4fcb-8237-dc231a84fbd0 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:33.983051 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ac4acc56-6fe0-4fcb-8237-dc231a84fbd0 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:33.983505 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ac4acc56-6fe0-4fcb-8237-dc231a84fbd0 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:33.984281 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ac4acc56-6fe0-4fcb-8237-dc231a84fbd0 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:33.984758 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ac4acc56-6fe0-4fcb-8237-dc231a84fbd0 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:34.063918 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-e29f041c-0cc1-4c19-b2ee-2a1d440868e4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:34.072643 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-e29f041c-0cc1-4c19-b2ee-2a1d440868e4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:34.074177 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-e29f041c-0cc1-4c19-b2ee-2a1d440868e4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:34.075302 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-e29f041c-0cc1-4c19-b2ee-2a1d440868e4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 200 len: 1723 microversion: 2.20 time: 0.218283 May 27 03:50:34.075863 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 589/1236] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:50:33 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 1723 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:50:34.079242 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-ac4acc56-6fe0-4fcb-8237-dc231a84fbd0 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action" status: 200 len: 28675 microversion: 2.1 time: 0.109288 May 27 03:50:34.079904 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 648/1237] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:50:33 2021] POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action => generated 28675 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 03:50:35.091011 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-f161854e-a682-4bd5-9663-cf21b355e016 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:35.091856 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-f161854e-a682-4bd5-9663-cf21b355e016 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:35.093536 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-a9efbc2a-6867-4e40-8802-6426ccbe35ea tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:50:35.094386 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-a9efbc2a-6867-4e40-8802-6426ccbe35ea tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:35.099231 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f161854e-a682-4bd5-9663-cf21b355e016 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:35.099691 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f161854e-a682-4bd5-9663-cf21b355e016 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:35.100501 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f161854e-a682-4bd5-9663-cf21b355e016 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:35.100950 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f161854e-a682-4bd5-9663-cf21b355e016 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:35.102016 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a9efbc2a-6867-4e40-8802-6426ccbe35ea tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:35.102468 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a9efbc2a-6867-4e40-8802-6426ccbe35ea tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:35.103246 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a9efbc2a-6867-4e40-8802-6426ccbe35ea tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:35.103684 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a9efbc2a-6867-4e40-8802-6426ccbe35ea tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:35.207619 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-f161854e-a682-4bd5-9663-cf21b355e016 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action" status: 200 len: 28675 microversion: 2.1 time: 0.120237 May 27 03:50:35.208261 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 590/1238] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:50:35 2021] POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action => generated 28675 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:50:35.295107 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-a9efbc2a-6867-4e40-8802-6426ccbe35ea tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:35.303670 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-a9efbc2a-6867-4e40-8802-6426ccbe35ea tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:35.305814 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-a9efbc2a-6867-4e40-8802-6426ccbe35ea tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:35.306936 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-a9efbc2a-6867-4e40-8802-6426ccbe35ea tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 200 len: 1723 microversion: 2.20 time: 0.217497 May 27 03:50:35.307501 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 649/1239] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:50:35 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 1723 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:50:36.220021 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-159896fe-7c46-4429-bae0-a5be3af5836e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:36.220983 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-159896fe-7c46-4429-bae0-a5be3af5836e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:36.229572 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-159896fe-7c46-4429-bae0-a5be3af5836e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:36.230029 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-159896fe-7c46-4429-bae0-a5be3af5836e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:36.230806 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-159896fe-7c46-4429-bae0-a5be3af5836e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:36.231249 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-159896fe-7c46-4429-bae0-a5be3af5836e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:36.324317 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-159896fe-7c46-4429-bae0-a5be3af5836e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action" status: 200 len: 28675 microversion: 2.1 time: 0.108325 May 27 03:50:36.325773 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 591/1240] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:50:36 2021] POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action => generated 28675 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:50:36.326018 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-a059a0fd-75cb-4f6b-9b85-175575895c88 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:50:36.326605 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-a059a0fd-75cb-4f6b-9b85-175575895c88 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:36.334850 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a059a0fd-75cb-4f6b-9b85-175575895c88 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:36.335320 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a059a0fd-75cb-4f6b-9b85-175575895c88 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:36.336716 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a059a0fd-75cb-4f6b-9b85-175575895c88 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:36.337151 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a059a0fd-75cb-4f6b-9b85-175575895c88 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:36.535070 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-a059a0fd-75cb-4f6b-9b85-175575895c88 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:36.543620 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-a059a0fd-75cb-4f6b-9b85-175575895c88 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:36.545189 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-a059a0fd-75cb-4f6b-9b85-175575895c88 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:36.546306 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-a059a0fd-75cb-4f6b-9b85-175575895c88 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 200 len: 1723 microversion: 2.20 time: 0.224215 May 27 03:50:36.546858 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 650/1241] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:50:36 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:50:37.337220 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-5df95f58-1605-4881-a07e-9fbf1d5241d2 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:37.338225 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-5df95f58-1605-4881-a07e-9fbf1d5241d2 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:37.346073 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-5df95f58-1605-4881-a07e-9fbf1d5241d2 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:37.346527 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-5df95f58-1605-4881-a07e-9fbf1d5241d2 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:37.347292 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-5df95f58-1605-4881-a07e-9fbf1d5241d2 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:37.347728 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-5df95f58-1605-4881-a07e-9fbf1d5241d2 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:37.446643 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-5df95f58-1605-4881-a07e-9fbf1d5241d2 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action" status: 200 len: 28675 microversion: 2.1 time: 0.113977 May 27 03:50:37.447266 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 592/1242] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:50:37 2021] POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action => generated 28675 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:50:37.563765 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-d6c61937-8793-4bdb-88ed-84062a054d2b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:50:37.564395 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-d6c61937-8793-4bdb-88ed-84062a054d2b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:37.571705 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d6c61937-8793-4bdb-88ed-84062a054d2b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:37.572148 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d6c61937-8793-4bdb-88ed-84062a054d2b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:37.572951 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d6c61937-8793-4bdb-88ed-84062a054d2b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:37.573384 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d6c61937-8793-4bdb-88ed-84062a054d2b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:37.774921 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-d6c61937-8793-4bdb-88ed-84062a054d2b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:37.783814 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-d6c61937-8793-4bdb-88ed-84062a054d2b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:37.785380 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-d6c61937-8793-4bdb-88ed-84062a054d2b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:37.786548 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-d6c61937-8793-4bdb-88ed-84062a054d2b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 200 len: 1723 microversion: 2.20 time: 0.226626 May 27 03:50:37.787111 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 651/1243] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:50:37 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 1723 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:50:38.458752 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-c303ca9b-b406-42f2-b610-97a70a7d474e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:38.459774 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-c303ca9b-b406-42f2-b610-97a70a7d474e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:38.468087 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c303ca9b-b406-42f2-b610-97a70a7d474e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:38.468584 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c303ca9b-b406-42f2-b610-97a70a7d474e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:38.469350 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c303ca9b-b406-42f2-b610-97a70a7d474e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:38.469787 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c303ca9b-b406-42f2-b610-97a70a7d474e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:38.804535 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-7896eb58-0403-4099-8fae-9b844a5e5f7e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:50:38.805154 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-7896eb58-0403-4099-8fae-9b844a5e5f7e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:38.812856 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7896eb58-0403-4099-8fae-9b844a5e5f7e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:38.813312 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7896eb58-0403-4099-8fae-9b844a5e5f7e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:38.814086 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7896eb58-0403-4099-8fae-9b844a5e5f7e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:38.814527 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7896eb58-0403-4099-8fae-9b844a5e5f7e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:39.009639 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-c303ca9b-b406-42f2-b610-97a70a7d474e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action" status: 200 len: 28675 microversion: 2.1 time: 0.554765 May 27 03:50:39.013439 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 593/1244] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:50:38 2021] POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action => generated 28675 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:50:39.013599 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-7896eb58-0403-4099-8fae-9b844a5e5f7e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:39.019592 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-7896eb58-0403-4099-8fae-9b844a5e5f7e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:39.021141 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-7896eb58-0403-4099-8fae-9b844a5e5f7e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:39.022363 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-7896eb58-0403-4099-8fae-9b844a5e5f7e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 200 len: 1723 microversion: 2.20 time: 0.221612 May 27 03:50:39.022855 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 652/1245] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:50:38 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 1723 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:50:40.021670 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-c865691b-000a-4021-83ff-f2dfe512bb14 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:40.022669 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-c865691b-000a-4021-83ff-f2dfe512bb14 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:40.031312 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c865691b-000a-4021-83ff-f2dfe512bb14 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:40.031761 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c865691b-000a-4021-83ff-f2dfe512bb14 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:40.032556 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c865691b-000a-4021-83ff-f2dfe512bb14 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:40.032990 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c865691b-000a-4021-83ff-f2dfe512bb14 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:40.040263 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-b53b4182-72bb-4200-9c09-1ff5907c7004 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:50:40.040910 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-b53b4182-72bb-4200-9c09-1ff5907c7004 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:40.048184 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b53b4182-72bb-4200-9c09-1ff5907c7004 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:40.048675 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b53b4182-72bb-4200-9c09-1ff5907c7004 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:40.049445 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b53b4182-72bb-4200-9c09-1ff5907c7004 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:40.049883 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b53b4182-72bb-4200-9c09-1ff5907c7004 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:40.128060 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-c865691b-000a-4021-83ff-f2dfe512bb14 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action" status: 200 len: 28675 microversion: 2.1 time: 0.110236 May 27 03:50:40.128668 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 594/1246] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:50:40 2021] POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action => generated 28675 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:50:40.247009 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-b53b4182-72bb-4200-9c09-1ff5907c7004 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:40.255560 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-b53b4182-72bb-4200-9c09-1ff5907c7004 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:40.257120 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-b53b4182-72bb-4200-9c09-1ff5907c7004 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:40.258745 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-b53b4182-72bb-4200-9c09-1ff5907c7004 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 200 len: 1744 microversion: 2.20 time: 0.222177 May 27 03:50:40.259300 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 653/1247] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:50:40 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 1744 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:50:41.141814 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-4fb795d3-d117-495a-93fa-caa06f868a13 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:41.142748 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-4fb795d3-d117-495a-93fa-caa06f868a13 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:41.150643 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-4fb795d3-d117-495a-93fa-caa06f868a13 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:41.151097 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-4fb795d3-d117-495a-93fa-caa06f868a13 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:41.151871 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-4fb795d3-d117-495a-93fa-caa06f868a13 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:41.152312 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-4fb795d3-d117-495a-93fa-caa06f868a13 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:41.254378 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-4fb795d3-d117-495a-93fa-caa06f868a13 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action" status: 200 len: 28675 microversion: 2.1 time: 0.117848 May 27 03:50:41.259053 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 595/1248] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:50:41 2021] POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action => generated 28675 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:50:41.276918 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-3ed56a6c-9748-44ff-a6f0-cb42106705d4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:50:41.277532 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-3ed56a6c-9748-44ff-a6f0-cb42106705d4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:41.285145 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3ed56a6c-9748-44ff-a6f0-cb42106705d4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:41.285702 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3ed56a6c-9748-44ff-a6f0-cb42106705d4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:41.286518 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3ed56a6c-9748-44ff-a6f0-cb42106705d4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:41.287082 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3ed56a6c-9748-44ff-a6f0-cb42106705d4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:41.483248 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-3ed56a6c-9748-44ff-a6f0-cb42106705d4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:41.492692 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-3ed56a6c-9748-44ff-a6f0-cb42106705d4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:41.494241 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-3ed56a6c-9748-44ff-a6f0-cb42106705d4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:41.495417 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-3ed56a6c-9748-44ff-a6f0-cb42106705d4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 200 len: 1744 microversion: 2.20 time: 0.222237 May 27 03:50:41.495982 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 654/1249] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:50:41 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 1744 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:50:42.267345 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-2f6b42bb-c21e-4fbc-8535-c86f86de0c70 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:42.268352 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-2f6b42bb-c21e-4fbc-8535-c86f86de0c70 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:42.276812 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2f6b42bb-c21e-4fbc-8535-c86f86de0c70 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:42.277262 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2f6b42bb-c21e-4fbc-8535-c86f86de0c70 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:42.278024 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2f6b42bb-c21e-4fbc-8535-c86f86de0c70 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:42.278460 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2f6b42bb-c21e-4fbc-8535-c86f86de0c70 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:42.370880 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-2f6b42bb-c21e-4fbc-8535-c86f86de0c70 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action" status: 200 len: 28675 microversion: 2.1 time: 0.107550 May 27 03:50:42.371481 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 596/1250] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:50:42 2021] POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action => generated 28675 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:50:42.513794 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-67258000-4f4e-413a-980a-c4c9cb59b141 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:50:42.514412 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-67258000-4f4e-413a-980a-c4c9cb59b141 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:42.522292 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-67258000-4f4e-413a-980a-c4c9cb59b141 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:42.522292 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-67258000-4f4e-413a-980a-c4c9cb59b141 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:42.522905 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-67258000-4f4e-413a-980a-c4c9cb59b141 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:42.523953 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-67258000-4f4e-413a-980a-c4c9cb59b141 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:42.813183 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-67258000-4f4e-413a-980a-c4c9cb59b141 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:42.822576 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-67258000-4f4e-413a-980a-c4c9cb59b141 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:42.824122 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-67258000-4f4e-413a-980a-c4c9cb59b141 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:42.825297 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-67258000-4f4e-413a-980a-c4c9cb59b141 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 200 len: 1744 microversion: 2.20 time: 0.315238 May 27 03:50:42.825863 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 655/1251] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:50:42 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 1744 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:50:43.383082 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-5ebe6cd3-9f4c-4521-bd99-390ae91e97ea tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:43.384155 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-5ebe6cd3-9f4c-4521-bd99-390ae91e97ea tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:43.391959 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-5ebe6cd3-9f4c-4521-bd99-390ae91e97ea tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:43.392455 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-5ebe6cd3-9f4c-4521-bd99-390ae91e97ea tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:43.393241 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-5ebe6cd3-9f4c-4521-bd99-390ae91e97ea tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:43.393689 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-5ebe6cd3-9f4c-4521-bd99-390ae91e97ea tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:43.501261 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [req-94aa16b5-2896-4747-a6e3-a639ba4a777f req-e50d935f-1762-4fc7-b45a-8041a1f09557 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaf24d29-a180-44ed-9549-e4cca130f813", "name": "network-vif-plugged", "status": "completed", "tag": "99d7c768-f910-47b6-ae4b-dc6dede2eec8"}]} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:43.502845 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:50:43.502845 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: warnings.warn(msg) May 27 03:50:43.505211 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-5ebe6cd3-9f4c-4521-bd99-390ae91e97ea tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action" status: 200 len: 28675 microversion: 2.1 time: 0.126093 May 27 03:50:43.506303 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 597/1252] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:50:43 2021] POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action => generated 28675 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:50:43.511129 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-94aa16b5-2896-4747-a6e3-a639ba4a777f req-e50d935f-1762-4fc7-b45a-8041a1f09557 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:43.511576 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-94aa16b5-2896-4747-a6e3-a639ba4a777f req-e50d935f-1762-4fc7-b45a-8041a1f09557 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:43.527852 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.compute.server_external_events [req-94aa16b5-2896-4747-a6e3-a639ba4a777f req-e50d935f-1762-4fc7-b45a-8041a1f09557 service nova] Creating event network-vif-plugged:99d7c768-f910-47b6-ae4b-dc6dede2eec8 for instance aaf24d29-a180-44ed-9549-e4cca130f813 on hv-cinder-79326 May 27 03:50:43.532846 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [req-94aa16b5-2896-4747-a6e3-a639ba4a777f req-e50d935f-1762-4fc7-b45a-8041a1f09557 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035267 May 27 03:50:43.533414 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 656/1253] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:50:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:50:43.843471 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-6a6a8031-30c0-4b65-9274-64b2ece474b2 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:50:43.844160 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-6a6a8031-30c0-4b65-9274-64b2ece474b2 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:43.851985 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6a6a8031-30c0-4b65-9274-64b2ece474b2 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:43.852456 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6a6a8031-30c0-4b65-9274-64b2ece474b2 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:43.853222 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6a6a8031-30c0-4b65-9274-64b2ece474b2 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:43.853654 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6a6a8031-30c0-4b65-9274-64b2ece474b2 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:44.188888 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-6a6a8031-30c0-4b65-9274-64b2ece474b2 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:44.197902 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-6a6a8031-30c0-4b65-9274-64b2ece474b2 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:44.199424 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-6a6a8031-30c0-4b65-9274-64b2ece474b2 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:44.200600 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-6a6a8031-30c0-4b65-9274-64b2ece474b2 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 200 len: 1744 microversion: 2.20 time: 0.361265 May 27 03:50:44.201158 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 598/1254] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:50:43 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 1744 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:50:44.517503 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-575adab3-35f1-4749-b31d-7b2ee17b8467 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:44.518524 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-575adab3-35f1-4749-b31d-7b2ee17b8467 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:44.526007 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-575adab3-35f1-4749-b31d-7b2ee17b8467 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:44.526462 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-575adab3-35f1-4749-b31d-7b2ee17b8467 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:44.527231 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-575adab3-35f1-4749-b31d-7b2ee17b8467 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:44.527671 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-575adab3-35f1-4749-b31d-7b2ee17b8467 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:44.643275 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-575adab3-35f1-4749-b31d-7b2ee17b8467 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action" status: 200 len: 28675 microversion: 2.1 time: 0.129791 May 27 03:50:44.643935 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 657/1255] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:50:44 2021] POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action => generated 28675 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:50:45.218568 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-2648d1b8-1583-4b1d-acec-ce0ae4d5afab tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:50:45.219111 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-2648d1b8-1583-4b1d-acec-ce0ae4d5afab tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:45.227330 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2648d1b8-1583-4b1d-acec-ce0ae4d5afab tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:45.227780 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2648d1b8-1583-4b1d-acec-ce0ae4d5afab tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:45.228562 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2648d1b8-1583-4b1d-acec-ce0ae4d5afab tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:45.230301 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2648d1b8-1583-4b1d-acec-ce0ae4d5afab tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:45.417500 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-2648d1b8-1583-4b1d-acec-ce0ae4d5afab tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:45.426190 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-2648d1b8-1583-4b1d-acec-ce0ae4d5afab tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:45.427731 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-2648d1b8-1583-4b1d-acec-ce0ae4d5afab tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:45.428910 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-2648d1b8-1583-4b1d-acec-ce0ae4d5afab tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 200 len: 1744 microversion: 2.20 time: 0.214270 May 27 03:50:45.429486 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 599/1256] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:50:45 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 1744 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:50:45.655418 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-8bbcdcb9-86a5-45ab-8e30-7f1c550b2fc7 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:45.656709 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-8bbcdcb9-86a5-45ab-8e30-7f1c550b2fc7 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:45.664548 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8bbcdcb9-86a5-45ab-8e30-7f1c550b2fc7 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:45.664998 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8bbcdcb9-86a5-45ab-8e30-7f1c550b2fc7 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:45.665757 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8bbcdcb9-86a5-45ab-8e30-7f1c550b2fc7 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:45.666188 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8bbcdcb9-86a5-45ab-8e30-7f1c550b2fc7 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:45.762242 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-8bbcdcb9-86a5-45ab-8e30-7f1c550b2fc7 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action" status: 200 len: 28675 microversion: 2.1 time: 0.110814 May 27 03:50:45.763147 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 658/1257] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:50:45 2021] POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action => generated 28675 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:50:46.446873 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-6570474f-1014-4639-a384-31fbc715a077 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:50:46.447463 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-6570474f-1014-4639-a384-31fbc715a077 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:46.454614 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6570474f-1014-4639-a384-31fbc715a077 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:46.455329 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6570474f-1014-4639-a384-31fbc715a077 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:46.455823 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6570474f-1014-4639-a384-31fbc715a077 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:46.456263 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6570474f-1014-4639-a384-31fbc715a077 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:46.660558 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-6570474f-1014-4639-a384-31fbc715a077 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:46.669893 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-6570474f-1014-4639-a384-31fbc715a077 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:46.671420 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-6570474f-1014-4639-a384-31fbc715a077 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:46.672583 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-6570474f-1014-4639-a384-31fbc715a077 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 200 len: 1744 microversion: 2.20 time: 0.229499 May 27 03:50:46.673136 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 600/1258] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:50:46 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 1744 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:50:46.775255 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-42ad4508-4c8a-4291-b516-75a8a12c5936 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:46.776390 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-42ad4508-4c8a-4291-b516-75a8a12c5936 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:46.784796 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-42ad4508-4c8a-4291-b516-75a8a12c5936 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:46.785251 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-42ad4508-4c8a-4291-b516-75a8a12c5936 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:46.786034 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-42ad4508-4c8a-4291-b516-75a8a12c5936 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:46.786475 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-42ad4508-4c8a-4291-b516-75a8a12c5936 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:46.888073 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-42ad4508-4c8a-4291-b516-75a8a12c5936 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action" status: 200 len: 28675 microversion: 2.1 time: 0.117441 May 27 03:50:46.888751 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 659/1259] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:50:46 2021] POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action => generated 28675 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:50:47.692043 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-79f6addc-077c-4086-b49e-f8feae42224f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:50:47.693362 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-79f6addc-077c-4086-b49e-f8feae42224f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:47.703527 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-79f6addc-077c-4086-b49e-f8feae42224f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:47.704328 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-79f6addc-077c-4086-b49e-f8feae42224f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:47.705233 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-79f6addc-077c-4086-b49e-f8feae42224f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:47.705873 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-79f6addc-077c-4086-b49e-f8feae42224f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:47.900728 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-1e1cc684-e9bc-4b89-ac3a-da6897829a2f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:47.902605 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-1e1cc684-e9bc-4b89-ac3a-da6897829a2f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:47.911029 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1e1cc684-e9bc-4b89-ac3a-da6897829a2f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:47.911844 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1e1cc684-e9bc-4b89-ac3a-da6897829a2f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:47.912735 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1e1cc684-e9bc-4b89-ac3a-da6897829a2f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:47.913411 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1e1cc684-e9bc-4b89-ac3a-da6897829a2f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:47.919239 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-79f6addc-077c-4086-b49e-f8feae42224f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:47.928357 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-79f6addc-077c-4086-b49e-f8feae42224f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:47.930893 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-79f6addc-077c-4086-b49e-f8feae42224f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:47.932272 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-79f6addc-077c-4086-b49e-f8feae42224f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 200 len: 1739 microversion: 2.20 time: 0.245446 May 27 03:50:47.932858 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 601/1260] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:50:47 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 1739 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:50:48.024886 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-1e1cc684-e9bc-4b89-ac3a-da6897829a2f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action" status: 200 len: 28675 microversion: 2.1 time: 0.128131 May 27 03:50:48.025806 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 660/1261] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:50:47 2021] POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action => generated 28675 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:50:48.951852 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-8b11a50e-6db5-4df0-98d7-20a8d4b6de95 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:50:48.952500 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-8b11a50e-6db5-4df0-98d7-20a8d4b6de95 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:48.960695 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8b11a50e-6db5-4df0-98d7-20a8d4b6de95 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:48.961466 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8b11a50e-6db5-4df0-98d7-20a8d4b6de95 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:48.962693 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8b11a50e-6db5-4df0-98d7-20a8d4b6de95 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:48.963193 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8b11a50e-6db5-4df0-98d7-20a8d4b6de95 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:49.040118 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-e4a5a1ee-a0cb-417e-be1c-6102e8db8234 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:49.041901 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-e4a5a1ee-a0cb-417e-be1c-6102e8db8234 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:49.052184 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e4a5a1ee-a0cb-417e-be1c-6102e8db8234 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:49.052945 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e4a5a1ee-a0cb-417e-be1c-6102e8db8234 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:49.054265 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e4a5a1ee-a0cb-417e-be1c-6102e8db8234 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:49.055799 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e4a5a1ee-a0cb-417e-be1c-6102e8db8234 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:49.172085 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-8b11a50e-6db5-4df0-98d7-20a8d4b6de95 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:49.182314 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-8b11a50e-6db5-4df0-98d7-20a8d4b6de95 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:49.183890 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-8b11a50e-6db5-4df0-98d7-20a8d4b6de95 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:49.184224 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-e4a5a1ee-a0cb-417e-be1c-6102e8db8234 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action" status: 200 len: 28675 microversion: 2.1 time: 0.146657 May 27 03:50:49.185016 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 661/1262] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:50:49 2021] POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action => generated 28675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:50:49.186539 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-8b11a50e-6db5-4df0-98d7-20a8d4b6de95 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 200 len: 1739 microversion: 2.20 time: 0.238781 May 27 03:50:49.187254 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 602/1263] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:50:48 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 1739 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:50:50.196475 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-88b1b914-f398-41a9-8277-619b16a7d88e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:50.197410 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-88b1b914-f398-41a9-8277-619b16a7d88e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:50.204423 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-c2210ec2-a5a4-41d1-996f-8190ec579df3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:50:50.205069 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-c2210ec2-a5a4-41d1-996f-8190ec579df3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:50.207111 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-88b1b914-f398-41a9-8277-619b16a7d88e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:50.207578 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-88b1b914-f398-41a9-8277-619b16a7d88e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:50.208368 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-88b1b914-f398-41a9-8277-619b16a7d88e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:50.208839 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-88b1b914-f398-41a9-8277-619b16a7d88e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:50.212835 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c2210ec2-a5a4-41d1-996f-8190ec579df3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:50.213285 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c2210ec2-a5a4-41d1-996f-8190ec579df3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:50.214059 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c2210ec2-a5a4-41d1-996f-8190ec579df3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:50.214496 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c2210ec2-a5a4-41d1-996f-8190ec579df3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:50.318063 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-88b1b914-f398-41a9-8277-619b16a7d88e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action" status: 200 len: 28675 microversion: 2.1 time: 0.125623 May 27 03:50:50.319787 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 662/1264] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:50:50 2021] POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action => generated 28675 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:50:50.428014 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-c2210ec2-a5a4-41d1-996f-8190ec579df3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:50.435408 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-c2210ec2-a5a4-41d1-996f-8190ec579df3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:50.437078 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-c2210ec2-a5a4-41d1-996f-8190ec579df3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:50.438218 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-c2210ec2-a5a4-41d1-996f-8190ec579df3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 200 len: 1739 microversion: 2.20 time: 0.237550 May 27 03:50:50.438767 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 603/1265] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:50:50 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 1739 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:50:51.330475 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-032301c6-9b31-44c4-9f7f-d999d35162c8 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:51.331504 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-032301c6-9b31-44c4-9f7f-d999d35162c8 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:51.339777 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-032301c6-9b31-44c4-9f7f-d999d35162c8 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:51.340240 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-032301c6-9b31-44c4-9f7f-d999d35162c8 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:51.341061 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-032301c6-9b31-44c4-9f7f-d999d35162c8 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:51.341511 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-032301c6-9b31-44c4-9f7f-d999d35162c8 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:51.443319 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-032301c6-9b31-44c4-9f7f-d999d35162c8 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action" status: 200 len: 28675 microversion: 2.1 time: 0.116756 May 27 03:50:51.448582 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 663/1266] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:50:51 2021] POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action => generated 28675 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:50:51.455495 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-2fa8f7e8-7779-4447-9a33-39b8c3707490 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:50:51.456187 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-2fa8f7e8-7779-4447-9a33-39b8c3707490 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:51.467595 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2fa8f7e8-7779-4447-9a33-39b8c3707490 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:51.468045 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2fa8f7e8-7779-4447-9a33-39b8c3707490 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:51.469140 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2fa8f7e8-7779-4447-9a33-39b8c3707490 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:51.469643 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2fa8f7e8-7779-4447-9a33-39b8c3707490 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:51.671062 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-2fa8f7e8-7779-4447-9a33-39b8c3707490 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:51.681063 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-2fa8f7e8-7779-4447-9a33-39b8c3707490 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:51.683185 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-2fa8f7e8-7779-4447-9a33-39b8c3707490 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:51.684448 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-2fa8f7e8-7779-4447-9a33-39b8c3707490 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 200 len: 1739 microversion: 2.20 time: 0.232651 May 27 03:50:51.685428 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 604/1267] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:50:51 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 1739 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:50:52.455594 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-a735a91e-cd64-4cff-994a-fab5d4ea2d26 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:52.456622 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-a735a91e-cd64-4cff-994a-fab5d4ea2d26 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:52.465324 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a735a91e-cd64-4cff-994a-fab5d4ea2d26 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:52.465996 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a735a91e-cd64-4cff-994a-fab5d4ea2d26 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:52.466767 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a735a91e-cd64-4cff-994a-fab5d4ea2d26 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:52.467204 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a735a91e-cd64-4cff-994a-fab5d4ea2d26 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:52.564049 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-a735a91e-cd64-4cff-994a-fab5d4ea2d26 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action" status: 200 len: 28675 microversion: 2.1 time: 0.112431 May 27 03:50:52.564770 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 664/1268] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:50:52 2021] POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action => generated 28675 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:50:52.703055 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-09265b34-9836-4a05-b92f-ea9ea1826e59 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:50:52.703747 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-09265b34-9836-4a05-b92f-ea9ea1826e59 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:52.711709 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-09265b34-9836-4a05-b92f-ea9ea1826e59 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:52.712093 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-09265b34-9836-4a05-b92f-ea9ea1826e59 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:52.712921 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-09265b34-9836-4a05-b92f-ea9ea1826e59 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:52.713349 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-09265b34-9836-4a05-b92f-ea9ea1826e59 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:53.043155 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-09265b34-9836-4a05-b92f-ea9ea1826e59 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:53.052378 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-09265b34-9836-4a05-b92f-ea9ea1826e59 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:53.053912 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-09265b34-9836-4a05-b92f-ea9ea1826e59 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:53.055065 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-09265b34-9836-4a05-b92f-ea9ea1826e59 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 200 len: 1739 microversion: 2.20 time: 0.355880 May 27 03:50:53.055618 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 605/1269] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:50:52 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 1739 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:50:53.575886 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-c8feadb3-ad51-46bb-aca6-3762aa9f5c58 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:53.576964 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-c8feadb3-ad51-46bb-aca6-3762aa9f5c58 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:53.585175 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c8feadb3-ad51-46bb-aca6-3762aa9f5c58 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:53.585956 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c8feadb3-ad51-46bb-aca6-3762aa9f5c58 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:53.586801 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c8feadb3-ad51-46bb-aca6-3762aa9f5c58 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:53.587306 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c8feadb3-ad51-46bb-aca6-3762aa9f5c58 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:53.692217 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-c8feadb3-ad51-46bb-aca6-3762aa9f5c58 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action" status: 200 len: 28675 microversion: 2.1 time: 0.120359 May 27 03:50:53.693098 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 665/1270] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:50:53 2021] POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action => generated 28675 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 03:50:54.073611 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-f8039f87-8da1-4dab-8e11-dac82f31495e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:50:54.074297 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-f8039f87-8da1-4dab-8e11-dac82f31495e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:54.081660 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f8039f87-8da1-4dab-8e11-dac82f31495e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:54.082051 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f8039f87-8da1-4dab-8e11-dac82f31495e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:54.082813 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f8039f87-8da1-4dab-8e11-dac82f31495e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:54.083248 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f8039f87-8da1-4dab-8e11-dac82f31495e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:54.287090 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-f8039f87-8da1-4dab-8e11-dac82f31495e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:54.295812 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-f8039f87-8da1-4dab-8e11-dac82f31495e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:54.297357 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-f8039f87-8da1-4dab-8e11-dac82f31495e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:54.298478 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-f8039f87-8da1-4dab-8e11-dac82f31495e tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 200 len: 1739 microversion: 2.20 time: 0.229308 May 27 03:50:54.299026 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 606/1271] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:50:54 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 1739 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:50:54.705357 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-e0c8e27b-1d06-4e1b-b063-c3997c661bc6 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:54.706454 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-e0c8e27b-1d06-4e1b-b063-c3997c661bc6 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:54.715172 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e0c8e27b-1d06-4e1b-b063-c3997c661bc6 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:54.715628 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e0c8e27b-1d06-4e1b-b063-c3997c661bc6 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:54.716467 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e0c8e27b-1d06-4e1b-b063-c3997c661bc6 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:54.716919 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e0c8e27b-1d06-4e1b-b063-c3997c661bc6 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:55.018458 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-e0c8e27b-1d06-4e1b-b063-c3997c661bc6 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action" status: 200 len: 28675 microversion: 2.1 time: 0.130582 May 27 03:50:55.018458 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 666/1272] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:50:54 2021] POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action => generated 28675 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:50:55.316858 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-b0e08aef-639d-4079-ab9c-f8e3bb04af58 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:50:55.317465 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-b0e08aef-639d-4079-ab9c-f8e3bb04af58 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:55.325268 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b0e08aef-639d-4079-ab9c-f8e3bb04af58 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:55.327702 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b0e08aef-639d-4079-ab9c-f8e3bb04af58 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:55.327702 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b0e08aef-639d-4079-ab9c-f8e3bb04af58 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:55.327702 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b0e08aef-639d-4079-ab9c-f8e3bb04af58 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:55.545689 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-b0e08aef-639d-4079-ab9c-f8e3bb04af58 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:55.558822 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-b0e08aef-639d-4079-ab9c-f8e3bb04af58 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:55.560350 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-b0e08aef-639d-4079-ab9c-f8e3bb04af58 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:55.562021 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-b0e08aef-639d-4079-ab9c-f8e3bb04af58 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 200 len: 1739 microversion: 2.20 time: 0.248852 May 27 03:50:55.563475 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 607/1273] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:50:55 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 1739 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:50:55.843998 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-baaebf03-9147-4e3f-9735-a7184fa5ff09 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:55.845040 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-baaebf03-9147-4e3f-9735-a7184fa5ff09 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:55.853751 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-baaebf03-9147-4e3f-9735-a7184fa5ff09 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:55.854448 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-baaebf03-9147-4e3f-9735-a7184fa5ff09 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:55.855229 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-baaebf03-9147-4e3f-9735-a7184fa5ff09 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:55.855664 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-baaebf03-9147-4e3f-9735-a7184fa5ff09 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:55.954088 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-baaebf03-9147-4e3f-9735-a7184fa5ff09 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action" status: 200 len: 28675 microversion: 2.1 time: 0.114007 May 27 03:50:55.954720 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 667/1274] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:50:55 2021] POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action => generated 28675 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:50:56.581344 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-a604cc2a-a386-47a9-ae51-da5be2100485 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:50:56.581951 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-a604cc2a-a386-47a9-ae51-da5be2100485 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:56.590105 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a604cc2a-a386-47a9-ae51-da5be2100485 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:56.590559 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a604cc2a-a386-47a9-ae51-da5be2100485 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:56.591379 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a604cc2a-a386-47a9-ae51-da5be2100485 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:56.591822 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a604cc2a-a386-47a9-ae51-da5be2100485 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:56.893055 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-a604cc2a-a386-47a9-ae51-da5be2100485 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:56.902823 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-a604cc2a-a386-47a9-ae51-da5be2100485 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:56.904351 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-a604cc2a-a386-47a9-ae51-da5be2100485 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:56.905788 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-a604cc2a-a386-47a9-ae51-da5be2100485 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 200 len: 1739 microversion: 2.20 time: 0.327982 May 27 03:50:56.906335 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 608/1275] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:50:56 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 1739 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:50:56.966194 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-a13f377e-b7ab-4e20-937f-656b686c7b1e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:56.967303 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-a13f377e-b7ab-4e20-937f-656b686c7b1e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:56.975887 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a13f377e-b7ab-4e20-937f-656b686c7b1e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:56.976336 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a13f377e-b7ab-4e20-937f-656b686c7b1e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:56.977144 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a13f377e-b7ab-4e20-937f-656b686c7b1e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:56.977608 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a13f377e-b7ab-4e20-937f-656b686c7b1e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:57.082319 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-a13f377e-b7ab-4e20-937f-656b686c7b1e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action" status: 200 len: 28675 microversion: 2.1 time: 0.120030 May 27 03:50:57.086510 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 668/1276] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:50:56 2021] POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action => generated 28675 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:50:57.933089 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-62871e92-781b-491e-bb33-653ec6c1c1db tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:50:57.933817 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-62871e92-781b-491e-bb33-653ec6c1c1db tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:57.941867 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-62871e92-781b-491e-bb33-653ec6c1c1db tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:57.942399 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-62871e92-781b-491e-bb33-653ec6c1c1db tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:57.943247 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-62871e92-781b-491e-bb33-653ec6c1c1db tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:57.944042 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-62871e92-781b-491e-bb33-653ec6c1c1db tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:58.094793 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-faf2e6f0-b456-40fc-866f-24dd062024e4 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:58.096573 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-faf2e6f0-b456-40fc-866f-24dd062024e4 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:58.111840 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-faf2e6f0-b456-40fc-866f-24dd062024e4 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:58.113007 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-faf2e6f0-b456-40fc-866f-24dd062024e4 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:58.114590 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-faf2e6f0-b456-40fc-866f-24dd062024e4 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:58.115264 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-faf2e6f0-b456-40fc-866f-24dd062024e4 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:58.175698 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-62871e92-781b-491e-bb33-653ec6c1c1db tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:58.185427 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-62871e92-781b-491e-bb33-653ec6c1c1db tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:58.187043 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-62871e92-781b-491e-bb33-653ec6c1c1db tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:58.188266 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-62871e92-781b-491e-bb33-653ec6c1c1db tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 200 len: 1739 microversion: 2.20 time: 0.261143 May 27 03:50:58.199125 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 609/1277] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:50:57 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 1739 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:50:58.236026 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-faf2e6f0-b456-40fc-866f-24dd062024e4 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action" status: 200 len: 28675 microversion: 2.1 time: 0.145169 May 27 03:50:58.237621 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 669/1278] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:50:58 2021] POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action => generated 28675 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 03:50:59.210538 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-00585ded-3388-44b8-af45-9de16c066f68 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:50:59.211100 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-00585ded-3388-44b8-af45-9de16c066f68 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:59.218784 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-00585ded-3388-44b8-af45-9de16c066f68 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:59.219229 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-00585ded-3388-44b8-af45-9de16c066f68 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:59.219987 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-00585ded-3388-44b8-af45-9de16c066f68 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:59.220608 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-00585ded-3388-44b8-af45-9de16c066f68 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:59.247915 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-4f05e7d0-c130-42bc-9338-dd5d18025407 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:50:59.392431 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-4f05e7d0-c130-42bc-9338-dd5d18025407 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:50:59.392431 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4f05e7d0-c130-42bc-9338-dd5d18025407 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:59.392431 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4f05e7d0-c130-42bc-9338-dd5d18025407 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:59.392431 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4f05e7d0-c130-42bc-9338-dd5d18025407 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:50:59.393530 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4f05e7d0-c130-42bc-9338-dd5d18025407 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:50:59.393530 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-4f05e7d0-c130-42bc-9338-dd5d18025407 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action" status: 200 len: 28675 microversion: 2.1 time: 0.111361 May 27 03:50:59.393530 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 670/1279] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:50:59 2021] POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action => generated 28675 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 03:50:59.422473 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-00585ded-3388-44b8-af45-9de16c066f68 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:59.431120 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-00585ded-3388-44b8-af45-9de16c066f68 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:59.432734 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-00585ded-3388-44b8-af45-9de16c066f68 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:50:59.433927 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-00585ded-3388-44b8-af45-9de16c066f68 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 200 len: 1739 microversion: 2.20 time: 0.229514 May 27 03:50:59.434541 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 610/1280] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:50:59 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 1739 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:51:00.367752 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-bdd0df73-f054-4749-a20f-60ce3f8860cc tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:51:00.368790 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-bdd0df73-f054-4749-a20f-60ce3f8860cc tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:51:00.376734 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-bdd0df73-f054-4749-a20f-60ce3f8860cc tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:00.382427 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-bdd0df73-f054-4749-a20f-60ce3f8860cc tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:00.382427 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-bdd0df73-f054-4749-a20f-60ce3f8860cc tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:00.382427 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-bdd0df73-f054-4749-a20f-60ce3f8860cc tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:00.452298 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-28e9d5ad-5f56-4b26-9e1b-2a618d932c4f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:51:00.452973 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-28e9d5ad-5f56-4b26-9e1b-2a618d932c4f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:51:00.460179 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-28e9d5ad-5f56-4b26-9e1b-2a618d932c4f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:00.460677 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-28e9d5ad-5f56-4b26-9e1b-2a618d932c4f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:00.461447 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-28e9d5ad-5f56-4b26-9e1b-2a618d932c4f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:00.462502 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-28e9d5ad-5f56-4b26-9e1b-2a618d932c4f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:00.471491 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-bdd0df73-f054-4749-a20f-60ce3f8860cc tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action" status: 200 len: 28675 microversion: 2.1 time: 0.107706 May 27 03:51:00.473009 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 671/1281] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:51:00 2021] POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action => generated 28675 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:51:00.654688 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-28e9d5ad-5f56-4b26-9e1b-2a618d932c4f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:00.663533 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-28e9d5ad-5f56-4b26-9e1b-2a618d932c4f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:00.665096 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-28e9d5ad-5f56-4b26-9e1b-2a618d932c4f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:00.666231 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-28e9d5ad-5f56-4b26-9e1b-2a618d932c4f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 200 len: 1739 microversion: 2.20 time: 0.217695 May 27 03:51:00.666791 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 611/1282] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:51:00 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 1739 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:51:01.484284 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-4cb6a170-f335-40cb-ae1c-c94654472fad tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:51:01.485350 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-4cb6a170-f335-40cb-ae1c-c94654472fad tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:51:01.493172 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4cb6a170-f335-40cb-ae1c-c94654472fad tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:01.493622 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4cb6a170-f335-40cb-ae1c-c94654472fad tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:01.494389 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4cb6a170-f335-40cb-ae1c-c94654472fad tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:01.494819 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4cb6a170-f335-40cb-ae1c-c94654472fad tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:01.589878 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-4cb6a170-f335-40cb-ae1c-c94654472fad tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action" status: 200 len: 28675 microversion: 2.1 time: 0.109585 May 27 03:51:01.590724 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 672/1283] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:51:01 2021] POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action => generated 28675 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:51:01.684270 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-13ffce6b-1160-4fd3-8a3b-3397055a7e58 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:51:01.684844 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-13ffce6b-1160-4fd3-8a3b-3397055a7e58 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:51:01.692487 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-13ffce6b-1160-4fd3-8a3b-3397055a7e58 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:01.692945 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-13ffce6b-1160-4fd3-8a3b-3397055a7e58 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:01.693714 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-13ffce6b-1160-4fd3-8a3b-3397055a7e58 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:01.694816 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-13ffce6b-1160-4fd3-8a3b-3397055a7e58 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:01.999266 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-13ffce6b-1160-4fd3-8a3b-3397055a7e58 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:02.007792 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-13ffce6b-1160-4fd3-8a3b-3397055a7e58 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:02.009841 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-13ffce6b-1160-4fd3-8a3b-3397055a7e58 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:02.010997 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-13ffce6b-1160-4fd3-8a3b-3397055a7e58 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 200 len: 1721 microversion: 2.20 time: 0.330570 May 27 03:51:02.011548 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 612/1284] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:51:01 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 1721 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:51:02.602877 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-8991f1a4-f0ec-4150-a9ec-4628b801d99c tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:51:02.603921 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-8991f1a4-f0ec-4150-a9ec-4628b801d99c tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:51:02.611773 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8991f1a4-f0ec-4150-a9ec-4628b801d99c tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:02.612231 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8991f1a4-f0ec-4150-a9ec-4628b801d99c tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:02.613053 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8991f1a4-f0ec-4150-a9ec-4628b801d99c tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:02.613497 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8991f1a4-f0ec-4150-a9ec-4628b801d99c tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:02.709537 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-8991f1a4-f0ec-4150-a9ec-4628b801d99c tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action" status: 200 len: 28675 microversion: 2.1 time: 0.111201 May 27 03:51:02.710122 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 673/1285] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:51:02 2021] POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action => generated 28675 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:51:03.029704 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-5c72634b-c2c7-4e27-aa0e-9e715caab23a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:51:03.030582 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-5c72634b-c2c7-4e27-aa0e-9e715caab23a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:51:03.037827 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-5c72634b-c2c7-4e27-aa0e-9e715caab23a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:03.038276 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-5c72634b-c2c7-4e27-aa0e-9e715caab23a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:03.039036 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-5c72634b-c2c7-4e27-aa0e-9e715caab23a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:03.039472 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-5c72634b-c2c7-4e27-aa0e-9e715caab23a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:03.232934 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-5c72634b-c2c7-4e27-aa0e-9e715caab23a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:03.241487 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-5c72634b-c2c7-4e27-aa0e-9e715caab23a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:03.243001 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-5c72634b-c2c7-4e27-aa0e-9e715caab23a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:03.244119 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-5c72634b-c2c7-4e27-aa0e-9e715caab23a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 200 len: 1721 microversion: 2.20 time: 0.218163 May 27 03:51:03.244706 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 613/1286] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:51:03 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 1721 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:51:03.721791 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-176dc70a-3b79-4a7c-a979-19398b972940 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:51:03.722733 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-176dc70a-3b79-4a7c-a979-19398b972940 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:51:03.730667 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-176dc70a-3b79-4a7c-a979-19398b972940 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:03.731120 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-176dc70a-3b79-4a7c-a979-19398b972940 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:03.731887 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-176dc70a-3b79-4a7c-a979-19398b972940 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:03.732351 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-176dc70a-3b79-4a7c-a979-19398b972940 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:03.824864 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-176dc70a-3b79-4a7c-a979-19398b972940 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action" status: 200 len: 28675 microversion: 2.1 time: 0.107077 May 27 03:51:03.825740 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 674/1287] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:51:03 2021] POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action => generated 28675 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:51:04.261525 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-1c7dad19-58c4-4a51-8d93-f4fb5659c9d2 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:51:04.262174 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-1c7dad19-58c4-4a51-8d93-f4fb5659c9d2 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:51:04.269485 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1c7dad19-58c4-4a51-8d93-f4fb5659c9d2 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:04.269942 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1c7dad19-58c4-4a51-8d93-f4fb5659c9d2 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:04.270718 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1c7dad19-58c4-4a51-8d93-f4fb5659c9d2 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:04.271162 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1c7dad19-58c4-4a51-8d93-f4fb5659c9d2 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:04.470131 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-1c7dad19-58c4-4a51-8d93-f4fb5659c9d2 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:04.479544 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-1c7dad19-58c4-4a51-8d93-f4fb5659c9d2 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:04.481123 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-1c7dad19-58c4-4a51-8d93-f4fb5659c9d2 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:04.482277 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-1c7dad19-58c4-4a51-8d93-f4fb5659c9d2 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 200 len: 1721 microversion: 2.20 time: 0.224562 May 27 03:51:04.482836 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 614/1288] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:51:04 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 1721 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:51:04.837397 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-367f4750-f0a8-4381-a710-4e4b74c17a12 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:51:04.838440 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-367f4750-f0a8-4381-a710-4e4b74c17a12 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:51:04.846467 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-367f4750-f0a8-4381-a710-4e4b74c17a12 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:04.846915 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-367f4750-f0a8-4381-a710-4e4b74c17a12 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:04.847682 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-367f4750-f0a8-4381-a710-4e4b74c17a12 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:04.848119 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-367f4750-f0a8-4381-a710-4e4b74c17a12 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:04.943580 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-367f4750-f0a8-4381-a710-4e4b74c17a12 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action" status: 200 len: 28675 microversion: 2.1 time: 0.110843 May 27 03:51:04.944232 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 675/1289] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:51:04 2021] POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action => generated 28675 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:51:05.500100 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-341ba15e-0238-4cde-9bed-5374ba461aef tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:51:05.500764 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-341ba15e-0238-4cde-9bed-5374ba461aef tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:51:05.507949 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-341ba15e-0238-4cde-9bed-5374ba461aef tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:05.508920 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-341ba15e-0238-4cde-9bed-5374ba461aef tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:05.509696 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-341ba15e-0238-4cde-9bed-5374ba461aef tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:05.510131 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-341ba15e-0238-4cde-9bed-5374ba461aef tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:05.534588 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [req-dfb7b965-2554-4579-b782-06cc82c32785 req-45e337e9-8aa2-43ed-97ad-d2ebfe023277 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaf24d29-a180-44ed-9549-e4cca130f813", "name": "network-vif-unplugged", "status": "completed", "tag": "99d7c768-f910-47b6-ae4b-dc6dede2eec8"}]} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:51:05.536004 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:51:05.536004 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: warnings.warn(msg) May 27 03:51:05.545069 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-dfb7b965-2554-4579-b782-06cc82c32785 req-45e337e9-8aa2-43ed-97ad-d2ebfe023277 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:05.545516 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-dfb7b965-2554-4579-b782-06cc82c32785 req-45e337e9-8aa2-43ed-97ad-d2ebfe023277 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:05.564333 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.compute.server_external_events [req-dfb7b965-2554-4579-b782-06cc82c32785 req-45e337e9-8aa2-43ed-97ad-d2ebfe023277 service nova] Unable to find a host for instance aaf24d29-a180-44ed-9549-e4cca130f813. Dropping event network-vif-unplugged {{(pid=113020) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} May 27 03:51:05.565225 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [req-dfb7b965-2554-4579-b782-06cc82c32785 req-45e337e9-8aa2-43ed-97ad-d2ebfe023277 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.035632 May 27 03:51:05.565808 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 676/1290] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:51:05 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 37 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) May 27 03:51:05.710013 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-341ba15e-0238-4cde-9bed-5374ba461aef tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:05.719187 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-341ba15e-0238-4cde-9bed-5374ba461aef tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:05.720708 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-341ba15e-0238-4cde-9bed-5374ba461aef tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:05.721826 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-341ba15e-0238-4cde-9bed-5374ba461aef tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 200 len: 1664 microversion: 2.20 time: 0.225429 May 27 03:51:05.722379 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 615/1291] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:51:05 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 1664 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:51:05.739110 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-5ff1925e-76dc-4053-bfb8-7ad1a066cf7c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e5a894f2-2708-46e1-ad5c-78685104585b"}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:51:05.740286 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-5ff1925e-76dc-4053-bfb8-7ad1a066cf7c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:51:05.747466 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-5ff1925e-76dc-4053-bfb8-7ad1a066cf7c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:05.747919 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-5ff1925e-76dc-4053-bfb8-7ad1a066cf7c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:05.748711 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-5ff1925e-76dc-4053-bfb8-7ad1a066cf7c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:05.749152 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-5ff1925e-76dc-4053-bfb8-7ad1a066cf7c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:05.955895 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-f7e1d5b0-9a04-4b12-bfc4-58b56b890f9d tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:51:05.956797 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-f7e1d5b0-9a04-4b12-bfc4-58b56b890f9d tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:51:05.964145 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f7e1d5b0-9a04-4b12-bfc4-58b56b890f9d tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:05.964702 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f7e1d5b0-9a04-4b12-bfc4-58b56b890f9d tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:05.965476 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f7e1d5b0-9a04-4b12-bfc4-58b56b890f9d tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:05.965917 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f7e1d5b0-9a04-4b12-bfc4-58b56b890f9d tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:06.086486 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-f7e1d5b0-9a04-4b12-bfc4-58b56b890f9d tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action" status: 200 len: 28675 microversion: 2.1 time: 0.134109 May 27 03:51:06.090488 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 616/1292] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:51:05 2021] POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action => generated 28675 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:51:07.098805 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-54fbb2b2-1082-42bc-8821-86a6eed4677e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:51:07.099817 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-54fbb2b2-1082-42bc-8821-86a6eed4677e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:51:07.107983 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-54fbb2b2-1082-42bc-8821-86a6eed4677e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:07.108471 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-54fbb2b2-1082-42bc-8821-86a6eed4677e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:07.113489 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-54fbb2b2-1082-42bc-8821-86a6eed4677e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:07.113489 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-54fbb2b2-1082-42bc-8821-86a6eed4677e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:07.177873 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-5ff1925e-76dc-4053-bfb8-7ad1a066cf7c tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.442392 May 27 03:51:07.178948 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 677/1293] 10.222.0.25 () {62 vars in 1364 bytes} [Thu May 27 03:51:05 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/os-volume_attachments => generated 188 bytes in 1444 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:51:07.200838 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-54fbb2b2-1082-42bc-8821-86a6eed4677e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action" status: 200 len: 28675 microversion: 2.1 time: 0.105908 May 27 03:51:07.201773 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 617/1294] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:51:07 2021] POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action => generated 28675 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 03:51:07.281379 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-029b4f11-ef8e-4c92-97c9-5801f2edb236 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:51:07.281875 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-029b4f11-ef8e-4c92-97c9-5801f2edb236 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:51:07.289059 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-029b4f11-ef8e-4c92-97c9-5801f2edb236 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:07.289611 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-029b4f11-ef8e-4c92-97c9-5801f2edb236 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:07.290424 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-029b4f11-ef8e-4c92-97c9-5801f2edb236 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:07.290859 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-029b4f11-ef8e-4c92-97c9-5801f2edb236 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:08.001082 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-029b4f11-ef8e-4c92-97c9-5801f2edb236 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "DELETE /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/os-volume_attachments/e5a894f2-2708-46e1-ad5c-78685104585b" status: 202 len: 0 microversion: 2.20 time: 0.723589 May 27 03:51:08.001681 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 678/1295] 10.222.0.25 () {60 vars in 1457 bytes} [Thu May 27 03:51:07 2021] DELETE /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/os-volume_attachments/e5a894f2-2708-46e1-ad5c-78685104585b => generated 0 bytes in 725 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 27 03:51:08.097517 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-1b20c4b2-f034-4dc8-bd14-133be420c481 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:51:08.098214 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-1b20c4b2-f034-4dc8-bd14-133be420c481 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:51:08.106695 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1b20c4b2-f034-4dc8-bd14-133be420c481 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:08.107265 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1b20c4b2-f034-4dc8-bd14-133be420c481 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:08.107915 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1b20c4b2-f034-4dc8-bd14-133be420c481 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:08.108358 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1b20c4b2-f034-4dc8-bd14-133be420c481 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:08.213150 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-4ae36378-5d9a-4d2c-9801-ea58c72d8532 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:51:08.214326 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-4ae36378-5d9a-4d2c-9801-ea58c72d8532 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:51:08.221942 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4ae36378-5d9a-4d2c-9801-ea58c72d8532 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:08.222390 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4ae36378-5d9a-4d2c-9801-ea58c72d8532 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:08.223164 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4ae36378-5d9a-4d2c-9801-ea58c72d8532 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:08.223605 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4ae36378-5d9a-4d2c-9801-ea58c72d8532 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:08.318804 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-4ae36378-5d9a-4d2c-9801-ea58c72d8532 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action" status: 200 len: 30229 microversion: 2.1 time: 0.109921 May 27 03:51:08.319338 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 679/1296] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:51:08 2021] POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action => generated 30229 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 03:51:08.402640 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-1b20c4b2-f034-4dc8-bd14-133be420c481 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action" status: 202 len: 0 microversion: 2.20 time: 0.309270 May 27 03:51:08.403234 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 618/1297] 10.222.0.25 () {62 vars in 1319 bytes} [Thu May 27 03:51:08 2021] POST /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813/action => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 27 03:51:08.411814 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-ff84e88e-c814-4f74-b76d-2b42a7e680c1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:51:08.415111 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-ff84e88e-c814-4f74-b76d-2b42a7e680c1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:51:08.421619 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ff84e88e-c814-4f74-b76d-2b42a7e680c1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:08.422145 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ff84e88e-c814-4f74-b76d-2b42a7e680c1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:08.422919 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ff84e88e-c814-4f74-b76d-2b42a7e680c1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:08.423354 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ff84e88e-c814-4f74-b76d-2b42a7e680c1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:08.625717 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-ff84e88e-c814-4f74-b76d-2b42a7e680c1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:08.642128 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-ff84e88e-c814-4f74-b76d-2b42a7e680c1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:08.643914 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-ff84e88e-c814-4f74-b76d-2b42a7e680c1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:08.645263 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-ff84e88e-c814-4f74-b76d-2b42a7e680c1 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 200 len: 1672 microversion: 2.20 time: 0.237445 May 27 03:51:08.646137 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 680/1298] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:51:08 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 1672 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:51:09.331171 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-db47b3d5-3906-442c-8150-9c9921cc863a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:51:09.332105 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-db47b3d5-3906-442c-8150-9c9921cc863a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:51:09.339401 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-db47b3d5-3906-442c-8150-9c9921cc863a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:09.339856 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-db47b3d5-3906-442c-8150-9c9921cc863a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:09.340654 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-db47b3d5-3906-442c-8150-9c9921cc863a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:09.341102 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-db47b3d5-3906-442c-8150-9c9921cc863a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:09.438281 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-db47b3d5-3906-442c-8150-9c9921cc863a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action" status: 200 len: 32324 microversion: 2.1 time: 0.111401 May 27 03:51:09.438898 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 619/1299] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:51:09 2021] POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action => generated 32324 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:51:09.807784 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-f30039c3-bdd2-41ec-950a-8370ce2f5f66 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:51:09.808421 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-f30039c3-bdd2-41ec-950a-8370ce2f5f66 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:51:09.815692 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f30039c3-bdd2-41ec-950a-8370ce2f5f66 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:09.816146 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f30039c3-bdd2-41ec-950a-8370ce2f5f66 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:09.816962 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f30039c3-bdd2-41ec-950a-8370ce2f5f66 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:09.817406 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f30039c3-bdd2-41ec-950a-8370ce2f5f66 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:10.015694 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-f30039c3-bdd2-41ec-950a-8370ce2f5f66 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:10.024554 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-f30039c3-bdd2-41ec-950a-8370ce2f5f66 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:10.026126 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-f30039c3-bdd2-41ec-950a-8370ce2f5f66 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:10.027262 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-f30039c3-bdd2-41ec-950a-8370ce2f5f66 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 200 len: 1730 microversion: 2.20 time: 0.367671 May 27 03:51:10.027862 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 681/1300] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:51:09 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 1730 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:51:10.450628 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-553d7657-472f-43f3-a0c5-4913136a60a0 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:51:10.451659 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-553d7657-472f-43f3-a0c5-4913136a60a0 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:51:10.460025 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-553d7657-472f-43f3-a0c5-4913136a60a0 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:10.460523 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-553d7657-472f-43f3-a0c5-4913136a60a0 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:10.461806 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-553d7657-472f-43f3-a0c5-4913136a60a0 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:10.462253 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-553d7657-472f-43f3-a0c5-4913136a60a0 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:10.556962 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-553d7657-472f-43f3-a0c5-4913136a60a0 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action" status: 200 len: 33450 microversion: 2.1 time: 0.110337 May 27 03:51:10.557564 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 620/1301] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:51:10 2021] POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action => generated 33450 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:51:11.046261 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-782aec87-0db2-4350-b7ee-14931234b5b8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:51:11.046865 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-782aec87-0db2-4350-b7ee-14931234b5b8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:51:11.053971 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-782aec87-0db2-4350-b7ee-14931234b5b8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:11.054418 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-782aec87-0db2-4350-b7ee-14931234b5b8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:11.055670 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-782aec87-0db2-4350-b7ee-14931234b5b8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:11.056100 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-782aec87-0db2-4350-b7ee-14931234b5b8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:11.253894 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-782aec87-0db2-4350-b7ee-14931234b5b8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:11.262666 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-782aec87-0db2-4350-b7ee-14931234b5b8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:11.264174 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-782aec87-0db2-4350-b7ee-14931234b5b8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:11.265311 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-782aec87-0db2-4350-b7ee-14931234b5b8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 200 len: 1730 microversion: 2.20 time: 0.222818 May 27 03:51:11.265849 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 682/1302] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:51:11 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 1730 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:51:11.568938 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-539b9971-e86a-4898-b0a0-095e9beea2d2 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:51:11.569942 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-539b9971-e86a-4898-b0a0-095e9beea2d2 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:51:11.578306 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-539b9971-e86a-4898-b0a0-095e9beea2d2 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:11.578756 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-539b9971-e86a-4898-b0a0-095e9beea2d2 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:11.579517 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-539b9971-e86a-4898-b0a0-095e9beea2d2 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:11.579954 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-539b9971-e86a-4898-b0a0-095e9beea2d2 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:12.283871 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-7793151a-f66f-4ef1-94fa-26b8942a2b80 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:51:12.284522 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-7793151a-f66f-4ef1-94fa-26b8942a2b80 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:51:12.292782 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7793151a-f66f-4ef1-94fa-26b8942a2b80 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:12.293241 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7793151a-f66f-4ef1-94fa-26b8942a2b80 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:12.294016 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7793151a-f66f-4ef1-94fa-26b8942a2b80 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:12.294457 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7793151a-f66f-4ef1-94fa-26b8942a2b80 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:12.497419 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-7793151a-f66f-4ef1-94fa-26b8942a2b80 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:12.509081 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-7793151a-f66f-4ef1-94fa-26b8942a2b80 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:12.510633 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-7793151a-f66f-4ef1-94fa-26b8942a2b80 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:12.511781 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-7793151a-f66f-4ef1-94fa-26b8942a2b80 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 200 len: 1730 microversion: 2.20 time: 0.231891 May 27 03:51:12.512464 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 683/1303] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:51:12 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 1730 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:51:13.531508 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-e8b48cc3-ff34-4abb-a9df-8ed692f7a302 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:51:13.532249 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-e8b48cc3-ff34-4abb-a9df-8ed692f7a302 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:51:13.539504 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e8b48cc3-ff34-4abb-a9df-8ed692f7a302 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:13.539952 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e8b48cc3-ff34-4abb-a9df-8ed692f7a302 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:13.540753 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e8b48cc3-ff34-4abb-a9df-8ed692f7a302 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:13.541190 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e8b48cc3-ff34-4abb-a9df-8ed692f7a302 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:13.737940 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-e8b48cc3-ff34-4abb-a9df-8ed692f7a302 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:13.747846 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-e8b48cc3-ff34-4abb-a9df-8ed692f7a302 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:13.749425 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-e8b48cc3-ff34-4abb-a9df-8ed692f7a302 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:13.750574 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-e8b48cc3-ff34-4abb-a9df-8ed692f7a302 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 200 len: 1730 microversion: 2.20 time: 0.223159 May 27 03:51:13.755340 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 684/1304] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:51:13 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 1730 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:51:14.768556 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-e7b13acd-63ea-4552-8ef5-2e4faaa479ff tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:51:14.769258 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-e7b13acd-63ea-4552-8ef5-2e4faaa479ff tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:51:14.777034 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e7b13acd-63ea-4552-8ef5-2e4faaa479ff tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:14.777488 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e7b13acd-63ea-4552-8ef5-2e4faaa479ff tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:14.778337 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e7b13acd-63ea-4552-8ef5-2e4faaa479ff tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:14.778775 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e7b13acd-63ea-4552-8ef5-2e4faaa479ff tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:14.986766 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-e7b13acd-63ea-4552-8ef5-2e4faaa479ff tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:14.995876 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-e7b13acd-63ea-4552-8ef5-2e4faaa479ff tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:14.997431 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-e7b13acd-63ea-4552-8ef5-2e4faaa479ff tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:14.998574 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-e7b13acd-63ea-4552-8ef5-2e4faaa479ff tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 200 len: 1730 microversion: 2.20 time: 0.233799 May 27 03:51:14.999130 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 685/1305] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:51:14 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 1730 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:51:16.017162 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-e845ab82-0ed9-4dbb-b331-12992f652f04 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:51:16.017843 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-e845ab82-0ed9-4dbb-b331-12992f652f04 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:51:16.025780 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e845ab82-0ed9-4dbb-b331-12992f652f04 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:16.026240 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e845ab82-0ed9-4dbb-b331-12992f652f04 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:16.027023 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e845ab82-0ed9-4dbb-b331-12992f652f04 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:16.027461 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e845ab82-0ed9-4dbb-b331-12992f652f04 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:16.229788 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-e845ab82-0ed9-4dbb-b331-12992f652f04 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:16.238484 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-e845ab82-0ed9-4dbb-b331-12992f652f04 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:16.240011 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-e845ab82-0ed9-4dbb-b331-12992f652f04 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:16.241190 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-e845ab82-0ed9-4dbb-b331-12992f652f04 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 200 len: 1730 microversion: 2.20 time: 0.227771 May 27 03:51:16.241754 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 686/1306] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:51:16 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 1730 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:51:17.259165 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-69d2aab9-666f-4058-ba09-6782f113ab4a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:51:17.259830 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-69d2aab9-666f-4058-ba09-6782f113ab4a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:51:17.267505 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-69d2aab9-666f-4058-ba09-6782f113ab4a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:17.267994 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-69d2aab9-666f-4058-ba09-6782f113ab4a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:17.268803 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-69d2aab9-666f-4058-ba09-6782f113ab4a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:17.269245 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-69d2aab9-666f-4058-ba09-6782f113ab4a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:17.476932 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-69d2aab9-666f-4058-ba09-6782f113ab4a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:17.485906 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-69d2aab9-666f-4058-ba09-6782f113ab4a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:17.487448 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-69d2aab9-666f-4058-ba09-6782f113ab4a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:17.488603 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-69d2aab9-666f-4058-ba09-6782f113ab4a tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 200 len: 1730 microversion: 2.20 time: 0.233212 May 27 03:51:17.489162 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 687/1307] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:51:17 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 1730 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:51:18.506651 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-eeb8f119-2f54-46d0-b805-948c0fd30720 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:51:18.507320 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-eeb8f119-2f54-46d0-b805-948c0fd30720 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:51:18.514658 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-eeb8f119-2f54-46d0-b805-948c0fd30720 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:18.515110 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-eeb8f119-2f54-46d0-b805-948c0fd30720 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:18.515870 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-eeb8f119-2f54-46d0-b805-948c0fd30720 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:18.516331 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-eeb8f119-2f54-46d0-b805-948c0fd30720 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:18.719955 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-eeb8f119-2f54-46d0-b805-948c0fd30720 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:18.729978 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-eeb8f119-2f54-46d0-b805-948c0fd30720 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:18.731731 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-eeb8f119-2f54-46d0-b805-948c0fd30720 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:18.733046 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-eeb8f119-2f54-46d0-b805-948c0fd30720 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 200 len: 1730 microversion: 2.20 time: 0.230075 May 27 03:51:18.733607 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 688/1308] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:51:18 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 1730 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:51:19.751979 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-76f93cd5-63c0-487a-a2a5-4d4418d57b82 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:51:19.752681 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-76f93cd5-63c0-487a-a2a5-4d4418d57b82 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:51:19.759825 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-76f93cd5-63c0-487a-a2a5-4d4418d57b82 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:19.760272 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-76f93cd5-63c0-487a-a2a5-4d4418d57b82 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:19.761071 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-76f93cd5-63c0-487a-a2a5-4d4418d57b82 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:19.761510 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-76f93cd5-63c0-487a-a2a5-4d4418d57b82 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:19.974280 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-76f93cd5-63c0-487a-a2a5-4d4418d57b82 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:19.983523 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-76f93cd5-63c0-487a-a2a5-4d4418d57b82 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:19.985089 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-76f93cd5-63c0-487a-a2a5-4d4418d57b82 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:19.986215 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-76f93cd5-63c0-487a-a2a5-4d4418d57b82 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 200 len: 1730 microversion: 2.20 time: 0.238052 May 27 03:51:19.986770 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 689/1309] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:51:19 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 1730 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:51:21.005622 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-96196031-0d93-47e9-9694-c5e309066911 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:51:21.006332 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-96196031-0d93-47e9-9694-c5e309066911 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:51:21.016812 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-96196031-0d93-47e9-9694-c5e309066911 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:21.017272 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-96196031-0d93-47e9-9694-c5e309066911 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:21.018089 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-96196031-0d93-47e9-9694-c5e309066911 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:21.018973 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-96196031-0d93-47e9-9694-c5e309066911 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:21.223414 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-96196031-0d93-47e9-9694-c5e309066911 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:21.232453 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-96196031-0d93-47e9-9694-c5e309066911 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:21.233980 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-96196031-0d93-47e9-9694-c5e309066911 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:21.235101 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-96196031-0d93-47e9-9694-c5e309066911 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 200 len: 1730 microversion: 2.20 time: 0.233534 May 27 03:51:21.235662 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 690/1310] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:51:21 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 1730 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:51:22.253839 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-6e18f00f-4b02-42c9-8ce0-8d1707c4b546 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:51:22.254493 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-6e18f00f-4b02-42c9-8ce0-8d1707c4b546 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:51:22.261928 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6e18f00f-4b02-42c9-8ce0-8d1707c4b546 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:22.262338 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6e18f00f-4b02-42c9-8ce0-8d1707c4b546 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:22.263104 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6e18f00f-4b02-42c9-8ce0-8d1707c4b546 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:22.263537 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6e18f00f-4b02-42c9-8ce0-8d1707c4b546 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:22.464910 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-6e18f00f-4b02-42c9-8ce0-8d1707c4b546 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:22.473704 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-6e18f00f-4b02-42c9-8ce0-8d1707c4b546 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:22.475232 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-6e18f00f-4b02-42c9-8ce0-8d1707c4b546 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:22.476367 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-6e18f00f-4b02-42c9-8ce0-8d1707c4b546 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 200 len: 1730 microversion: 2.20 time: 0.226387 May 27 03:51:22.476988 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 691/1311] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:51:22 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 1730 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:51:22.749299 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 03:51:22.749514 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: Thu May 27 03:51:22 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 03:51:23.494580 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-3bd28e33-9c79-4f33-b21f-958531e8d4e8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:51:23.495815 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-3bd28e33-9c79-4f33-b21f-958531e8d4e8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:51:23.503752 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3bd28e33-9c79-4f33-b21f-958531e8d4e8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:23.504099 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3bd28e33-9c79-4f33-b21f-958531e8d4e8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:23.504913 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3bd28e33-9c79-4f33-b21f-958531e8d4e8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:23.505361 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3bd28e33-9c79-4f33-b21f-958531e8d4e8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:23.718587 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-3bd28e33-9c79-4f33-b21f-958531e8d4e8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:23.727182 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-3bd28e33-9c79-4f33-b21f-958531e8d4e8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:23.728734 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-3bd28e33-9c79-4f33-b21f-958531e8d4e8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:23.730375 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-3bd28e33-9c79-4f33-b21f-958531e8d4e8 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 200 len: 1730 microversion: 2.20 time: 0.239694 May 27 03:51:23.730917 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 692/1312] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:51:23 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 1730 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:51:24.748736 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-de9c1502-d27f-4589-b1f9-2438929135e6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:51:24.749382 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-de9c1502-d27f-4589-b1f9-2438929135e6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:51:24.756712 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-de9c1502-d27f-4589-b1f9-2438929135e6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:24.761254 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-de9c1502-d27f-4589-b1f9-2438929135e6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:24.761254 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-de9c1502-d27f-4589-b1f9-2438929135e6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:24.761254 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-de9c1502-d27f-4589-b1f9-2438929135e6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:24.953764 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-de9c1502-d27f-4589-b1f9-2438929135e6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:24.962342 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-de9c1502-d27f-4589-b1f9-2438929135e6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:24.963860 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-de9c1502-d27f-4589-b1f9-2438929135e6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:24.965000 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-de9c1502-d27f-4589-b1f9-2438929135e6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 200 len: 1730 microversion: 2.20 time: 0.220561 May 27 03:51:24.965548 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 693/1313] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:51:24 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 1730 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:51:25.983515 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-9e950d63-c37f-4406-a20e-03eb2e94e13d tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:51:25.984190 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-9e950d63-c37f-4406-a20e-03eb2e94e13d tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:51:25.991821 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9e950d63-c37f-4406-a20e-03eb2e94e13d tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:25.992279 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9e950d63-c37f-4406-a20e-03eb2e94e13d tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:25.993073 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9e950d63-c37f-4406-a20e-03eb2e94e13d tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:25.993512 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9e950d63-c37f-4406-a20e-03eb2e94e13d tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:26.185452 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-9e950d63-c37f-4406-a20e-03eb2e94e13d tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:26.193981 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-9e950d63-c37f-4406-a20e-03eb2e94e13d tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:26.195509 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-9e950d63-c37f-4406-a20e-03eb2e94e13d tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:26.196661 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-9e950d63-c37f-4406-a20e-03eb2e94e13d tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 200 len: 1730 microversion: 2.20 time: 0.217352 May 27 03:51:26.197210 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 694/1314] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:51:25 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 1730 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:51:27.173603 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-539b9971-e86a-4898-b0a0-095e9beea2d2 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action" status: 200 len: 38335 microversion: 2.1 time: 15.608432 May 27 03:51:27.174266 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 621/1315] 10.222.0.25 () {60 vars in 1278 bytes} [Thu May 27 03:51:11 2021] POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/action => generated 38335 bytes in 15610 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 03:51:27.185452 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-716c5008-4732-45ba-95f8-3525bd41518e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:51:27.185953 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-716c5008-4732-45ba-95f8-3525bd41518e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:51:27.194421 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-716c5008-4732-45ba-95f8-3525bd41518e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:27.194867 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-716c5008-4732-45ba-95f8-3525bd41518e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:27.195634 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-716c5008-4732-45ba-95f8-3525bd41518e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:27.196078 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-716c5008-4732-45ba-95f8-3525bd41518e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:27.216117 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-aca95bae-932f-4320-804c-0c517fb9aea3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:51:27.216867 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-aca95bae-932f-4320-804c-0c517fb9aea3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:51:27.224754 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-aca95bae-932f-4320-804c-0c517fb9aea3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:27.225229 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-aca95bae-932f-4320-804c-0c517fb9aea3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:27.226014 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-aca95bae-932f-4320-804c-0c517fb9aea3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:27.226461 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-aca95bae-932f-4320-804c-0c517fb9aea3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:27.259785 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-716c5008-4732-45ba-95f8-3525bd41518e tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/ips" status: 200 len: 145 microversion: 2.1 time: 0.077699 May 27 03:51:27.260048 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 695/1316] 10.222.0.25 () {58 vars in 1248 bytes} [Thu May 27 03:51:27 2021] GET /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/ips => generated 145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:51:27.567505 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-aca95bae-932f-4320-804c-0c517fb9aea3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:27.576902 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-aca95bae-932f-4320-804c-0c517fb9aea3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:27.578431 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-aca95bae-932f-4320-804c-0c517fb9aea3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:27.579567 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-aca95bae-932f-4320-804c-0c517fb9aea3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 200 len: 1730 microversion: 2.20 time: 0.368529 May 27 03:51:27.580130 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 622/1317] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:51:27 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 1730 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:51:28.597728 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-4d4ed92a-e194-44bb-8c51-535127e5b0cd tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:51:28.598384 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-4d4ed92a-e194-44bb-8c51-535127e5b0cd tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:51:28.606133 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4d4ed92a-e194-44bb-8c51-535127e5b0cd tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:28.606615 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4d4ed92a-e194-44bb-8c51-535127e5b0cd tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:28.607370 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4d4ed92a-e194-44bb-8c51-535127e5b0cd tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:28.607799 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-4d4ed92a-e194-44bb-8c51-535127e5b0cd tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:28.803258 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-4d4ed92a-e194-44bb-8c51-535127e5b0cd tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:28.812475 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-4d4ed92a-e194-44bb-8c51-535127e5b0cd tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:28.814026 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-4d4ed92a-e194-44bb-8c51-535127e5b0cd tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:28.815159 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-4d4ed92a-e194-44bb-8c51-535127e5b0cd tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 200 len: 1730 microversion: 2.20 time: 0.221154 May 27 03:51:28.815711 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 696/1318] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:51:28 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 1730 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:51:29.834344 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-a8905c39-59fb-4f40-aad4-88d3c912458b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:51:29.834967 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-a8905c39-59fb-4f40-aad4-88d3c912458b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:51:29.842666 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a8905c39-59fb-4f40-aad4-88d3c912458b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:29.843120 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a8905c39-59fb-4f40-aad4-88d3c912458b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:29.843885 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a8905c39-59fb-4f40-aad4-88d3c912458b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:29.844326 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-a8905c39-59fb-4f40-aad4-88d3c912458b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:30.032841 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-a8905c39-59fb-4f40-aad4-88d3c912458b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:30.041451 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-a8905c39-59fb-4f40-aad4-88d3c912458b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:30.042968 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-a8905c39-59fb-4f40-aad4-88d3c912458b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:30.044095 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-a8905c39-59fb-4f40-aad4-88d3c912458b tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 200 len: 1730 microversion: 2.20 time: 0.213549 May 27 03:51:30.044681 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 623/1319] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:51:29 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 1730 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:51:30.172531 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-42c98209-9508-4883-947f-4d912e4b76c5 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6a326ce1-f611-487f-b15c-b7c0e7d506f8"}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:51:30.174323 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-42c98209-9508-4883-947f-4d912e4b76c5 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:51:30.182180 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-42c98209-9508-4883-947f-4d912e4b76c5 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:30.182632 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-42c98209-9508-4883-947f-4d912e4b76c5 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:30.183403 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-42c98209-9508-4883-947f-4d912e4b76c5 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:30.183840 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-42c98209-9508-4883-947f-4d912e4b76c5 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:30.998371 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-42c98209-9508-4883-947f-4d912e4b76c5 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.830232 May 27 03:51:30.998976 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 697/1320] 10.222.0.25 () {60 vars in 1323 bytes} [Thu May 27 03:51:30 2021] POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/os-volume_attachments => generated 194 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:51:31.062604 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-95c25b6f-1873-4ad4-bc23-a0c6cf46bd42 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:51:31.063224 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-95c25b6f-1873-4ad4-bc23-a0c6cf46bd42 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:51:31.070442 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-95c25b6f-1873-4ad4-bc23-a0c6cf46bd42 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:31.070835 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-95c25b6f-1873-4ad4-bc23-a0c6cf46bd42 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:31.071606 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-95c25b6f-1873-4ad4-bc23-a0c6cf46bd42 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:31.072053 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-95c25b6f-1873-4ad4-bc23-a0c6cf46bd42 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:31.376589 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-95c25b6f-1873-4ad4-bc23-a0c6cf46bd42 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:31.385363 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-95c25b6f-1873-4ad4-bc23-a0c6cf46bd42 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:31.386877 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-95c25b6f-1873-4ad4-bc23-a0c6cf46bd42 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:31.388047 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-95c25b6f-1873-4ad4-bc23-a0c6cf46bd42 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 200 len: 1730 microversion: 2.20 time: 0.329164 May 27 03:51:31.388628 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 624/1321] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:51:31 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 1730 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:51:32.407312 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-426702d7-a48c-4fd9-976d-15bac3fa7846 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:51:32.408037 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-426702d7-a48c-4fd9-976d-15bac3fa7846 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:51:32.419205 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-426702d7-a48c-4fd9-976d-15bac3fa7846 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:32.419659 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-426702d7-a48c-4fd9-976d-15bac3fa7846 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:32.424131 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-426702d7-a48c-4fd9-976d-15bac3fa7846 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:32.424131 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-426702d7-a48c-4fd9-976d-15bac3fa7846 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:32.612604 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-426702d7-a48c-4fd9-976d-15bac3fa7846 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:32.621122 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-426702d7-a48c-4fd9-976d-15bac3fa7846 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:32.622639 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-426702d7-a48c-4fd9-976d-15bac3fa7846 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:32.623762 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-426702d7-a48c-4fd9-976d-15bac3fa7846 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 200 len: 1730 microversion: 2.20 time: 0.221348 May 27 03:51:32.624927 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 698/1322] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:51:32 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 1730 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:51:33.642329 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-72a7404d-3cfa-46d0-800c-75747af20443 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:51:33.642970 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-72a7404d-3cfa-46d0-800c-75747af20443 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:51:33.650616 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-72a7404d-3cfa-46d0-800c-75747af20443 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:33.651072 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-72a7404d-3cfa-46d0-800c-75747af20443 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:33.651850 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-72a7404d-3cfa-46d0-800c-75747af20443 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:33.652290 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-72a7404d-3cfa-46d0-800c-75747af20443 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:33.714319 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [req-f1658f36-d7d7-4378-9efd-59f34abf3279 req-b11467df-693e-4c6e-8b53-3ceac274c624 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaf24d29-a180-44ed-9549-e4cca130f813", "name": "network-vif-plugged", "status": "completed", "tag": "99d7c768-f910-47b6-ae4b-dc6dede2eec8"}]} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:51:33.715980 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:51:33.715980 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: warnings.warn(msg) May 27 03:51:33.724453 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-f1658f36-d7d7-4378-9efd-59f34abf3279 req-b11467df-693e-4c6e-8b53-3ceac274c624 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:33.724840 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-f1658f36-d7d7-4378-9efd-59f34abf3279 req-b11467df-693e-4c6e-8b53-3ceac274c624 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:33.740701 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.compute.server_external_events [req-f1658f36-d7d7-4378-9efd-59f34abf3279 req-b11467df-693e-4c6e-8b53-3ceac274c624 service nova] Creating event network-vif-plugged:99d7c768-f910-47b6-ae4b-dc6dede2eec8 for instance aaf24d29-a180-44ed-9549-e4cca130f813 on hv-cinder-79326 May 27 03:51:33.745751 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [req-f1658f36-d7d7-4378-9efd-59f34abf3279 req-b11467df-693e-4c6e-8b53-3ceac274c624 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036705 May 27 03:51:33.746387 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 699/1323] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:51:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:51:33.851345 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-72a7404d-3cfa-46d0-800c-75747af20443 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:33.860879 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-72a7404d-3cfa-46d0-800c-75747af20443 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:33.864651 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-72a7404d-3cfa-46d0-800c-75747af20443 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:33.864651 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-72a7404d-3cfa-46d0-800c-75747af20443 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 200 len: 1730 microversion: 2.20 time: 0.225481 May 27 03:51:33.864651 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 625/1324] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:51:33 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 1730 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:51:34.882111 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-ab07de33-e96b-4226-a93f-9f70ad28bf52 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:51:34.882855 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-ab07de33-e96b-4226-a93f-9f70ad28bf52 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:51:34.891298 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ab07de33-e96b-4226-a93f-9f70ad28bf52 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:34.894111 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ab07de33-e96b-4226-a93f-9f70ad28bf52 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:34.894111 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ab07de33-e96b-4226-a93f-9f70ad28bf52 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:34.894111 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ab07de33-e96b-4226-a93f-9f70ad28bf52 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:35.172901 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-ab07de33-e96b-4226-a93f-9f70ad28bf52 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:35.181423 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-ab07de33-e96b-4226-a93f-9f70ad28bf52 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:35.182945 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-ab07de33-e96b-4226-a93f-9f70ad28bf52 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:35.184061 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-ab07de33-e96b-4226-a93f-9f70ad28bf52 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 200 len: 1730 microversion: 2.20 time: 0.306193 May 27 03:51:35.184641 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 700/1325] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:51:34 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 1730 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:51:36.202092 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-51235609-fdad-4423-a114-8544910524d6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:51:36.202707 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-51235609-fdad-4423-a114-8544910524d6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:51:36.210034 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-51235609-fdad-4423-a114-8544910524d6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:36.210480 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-51235609-fdad-4423-a114-8544910524d6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:36.211243 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-51235609-fdad-4423-a114-8544910524d6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:36.211684 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-51235609-fdad-4423-a114-8544910524d6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:36.411951 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-51235609-fdad-4423-a114-8544910524d6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:36.420655 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-51235609-fdad-4423-a114-8544910524d6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:36.422762 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-51235609-fdad-4423-a114-8544910524d6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:36.423903 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-51235609-fdad-4423-a114-8544910524d6 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 200 len: 1730 microversion: 2.20 time: 0.225621 May 27 03:51:36.424479 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 626/1326] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:51:36 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 1730 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:51:37.442354 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-52e67f92-ec2e-49ac-a635-2d30d10bc046 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:51:37.442988 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-52e67f92-ec2e-49ac-a635-2d30d10bc046 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:51:37.450300 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-52e67f92-ec2e-49ac-a635-2d30d10bc046 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:37.450815 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-52e67f92-ec2e-49ac-a635-2d30d10bc046 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:37.451639 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-52e67f92-ec2e-49ac-a635-2d30d10bc046 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:37.452074 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-52e67f92-ec2e-49ac-a635-2d30d10bc046 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:37.649396 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-52e67f92-ec2e-49ac-a635-2d30d10bc046 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:37.658564 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-52e67f92-ec2e-49ac-a635-2d30d10bc046 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:37.659856 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-52e67f92-ec2e-49ac-a635-2d30d10bc046 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:37.661249 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-52e67f92-ec2e-49ac-a635-2d30d10bc046 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 200 len: 1717 microversion: 2.20 time: 0.223189 May 27 03:51:37.661801 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 701/1327] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:51:37 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 1717 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:51:38.786149 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-9a392386-f115-4657-84ad-b707f5875b4a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:51:38.787117 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-9a392386-f115-4657-84ad-b707f5875b4a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:51:38.794799 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-9a392386-f115-4657-84ad-b707f5875b4a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:38.795190 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-9a392386-f115-4657-84ad-b707f5875b4a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:38.795962 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-9a392386-f115-4657-84ad-b707f5875b4a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:38.796486 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-9a392386-f115-4657-84ad-b707f5875b4a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:38.862176 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-9a392386-f115-4657-84ad-b707f5875b4a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079796 May 27 03:51:38.862743 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 627/1328] 10.222.0.25 () {58 vars in 1302 bytes} [Thu May 27 03:51:38 2021] GET /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:51:38.872332 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-64392fad-9795-4824-82cd-61ea4f58b4ae tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:51:38.872904 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-64392fad-9795-4824-82cd-61ea4f58b4ae tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:51:38.880836 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-64392fad-9795-4824-82cd-61ea4f58b4ae tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:38.881295 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-64392fad-9795-4824-82cd-61ea4f58b4ae tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:38.882079 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-64392fad-9795-4824-82cd-61ea4f58b4ae tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:38.882521 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-64392fad-9795-4824-82cd-61ea4f58b4ae tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:38.946683 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-64392fad-9795-4824-82cd-61ea4f58b4ae tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/os-volume_attachments/6a326ce1-f611-487f-b15c-b7c0e7d506f8" status: 200 len: 194 microversion: 2.1 time: 0.078018 May 27 03:51:38.947265 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 702/1329] 10.222.0.25 () {58 vars in 1413 bytes} [Thu May 27 03:51:38 2021] GET /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/os-volume_attachments/6a326ce1-f611-487f-b15c-b7c0e7d506f8 => generated 194 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:51:40.636317 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-b2776903-95f9-4e67-97b6-c4497532ddf4 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9d4b8685-05fe-4943-b75c-10d6a69fcae7"}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:51:40.637584 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-b2776903-95f9-4e67-97b6-c4497532ddf4 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:51:40.644846 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b2776903-95f9-4e67-97b6-c4497532ddf4 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:40.645308 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b2776903-95f9-4e67-97b6-c4497532ddf4 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:40.646086 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b2776903-95f9-4e67-97b6-c4497532ddf4 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:40.646534 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b2776903-95f9-4e67-97b6-c4497532ddf4 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:41.431333 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-b2776903-95f9-4e67-97b6-c4497532ddf4 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.798571 May 27 03:51:41.431932 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 628/1330] 10.222.0.25 () {60 vars in 1323 bytes} [Thu May 27 03:51:40 2021] POST /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/os-volume_attachments => generated 194 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:51:49.188381 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-91a28b93-6ff3-46fe-8131-6523a72ac480 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:51:49.189399 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-91a28b93-6ff3-46fe-8131-6523a72ac480 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:51:49.197652 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-91a28b93-6ff3-46fe-8131-6523a72ac480 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:49.198108 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-91a28b93-6ff3-46fe-8131-6523a72ac480 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:49.198883 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-91a28b93-6ff3-46fe-8131-6523a72ac480 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:49.199326 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-91a28b93-6ff3-46fe-8131-6523a72ac480 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:49.262212 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-91a28b93-6ff3-46fe-8131-6523a72ac480 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.077448 May 27 03:51:49.262724 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 703/1331] 10.222.0.25 () {58 vars in 1302 bytes} [Thu May 27 03:51:49 2021] GET /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/os-volume_attachments => generated 371 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:51:49.496807 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-84ba8410-ca08-41f3-ad76-c9ba065d2244 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:51:49.497380 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-84ba8410-ca08-41f3-ad76-c9ba065d2244 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:51:49.506062 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-84ba8410-ca08-41f3-ad76-c9ba065d2244 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:49.506513 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-84ba8410-ca08-41f3-ad76-c9ba065d2244 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:49.507275 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-84ba8410-ca08-41f3-ad76-c9ba065d2244 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:49.507714 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-84ba8410-ca08-41f3-ad76-c9ba065d2244 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:49.569259 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-84ba8410-ca08-41f3-ad76-c9ba065d2244 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/os-volume_attachments/6a326ce1-f611-487f-b15c-b7c0e7d506f8" status: 200 len: 194 microversion: 2.1 time: 0.077113 May 27 03:51:49.569848 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 629/1332] 10.222.0.25 () {58 vars in 1413 bytes} [Thu May 27 03:51:49 2021] GET /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/os-volume_attachments/6a326ce1-f611-487f-b15c-b7c0e7d506f8 => generated 194 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:51:49.580332 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-e73d876b-29c3-43ab-9134-e93de6e1c661 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:51:49.580928 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-e73d876b-29c3-43ab-9134-e93de6e1c661 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:51:49.588007 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e73d876b-29c3-43ab-9134-e93de6e1c661 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:49.588488 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e73d876b-29c3-43ab-9134-e93de6e1c661 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:49.589276 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e73d876b-29c3-43ab-9134-e93de6e1c661 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:49.589726 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e73d876b-29c3-43ab-9134-e93de6e1c661 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:49.745277 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.objects.instance [None req-e73d876b-29c3-43ab-9134-e93de6e1c661 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lazy-loading 'services' on Instance uuid 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962 {{(pid=113020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 27 03:51:49.994064 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-e73d876b-29c3-43ab-9134-e93de6e1c661 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "DELETE /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/os-volume_attachments/6a326ce1-f611-487f-b15c-b7c0e7d506f8" status: 202 len: 0 microversion: 2.1 time: 0.417121 May 27 03:51:49.994561 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 704/1333] 10.222.0.25 () {58 vars in 1416 bytes} [Thu May 27 03:51:49 2021] DELETE /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/os-volume_attachments/6a326ce1-f611-487f-b15c-b7c0e7d506f8 => generated 0 bytes in 419 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:51:52.278428 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-4e7accc4-3f89-4540-acd3-0b4215a4cf76 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:51:52.278929 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-4e7accc4-3f89-4540-acd3-0b4215a4cf76 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:51:52.287346 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-4e7accc4-3f89-4540-acd3-0b4215a4cf76 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:52.287811 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-4e7accc4-3f89-4540-acd3-0b4215a4cf76 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:52.288622 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-4e7accc4-3f89-4540-acd3-0b4215a4cf76 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:52.289071 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-4e7accc4-3f89-4540-acd3-0b4215a4cf76 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:52.350442 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-4e7accc4-3f89-4540-acd3-0b4215a4cf76 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/os-volume_attachments/9d4b8685-05fe-4943-b75c-10d6a69fcae7" status: 200 len: 194 microversion: 2.1 time: 0.075753 May 27 03:51:52.351021 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 630/1334] 10.222.0.25 () {58 vars in 1413 bytes} [Thu May 27 03:51:52 2021] GET /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/os-volume_attachments/9d4b8685-05fe-4943-b75c-10d6a69fcae7 => generated 194 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:51:52.361344 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-0dd27ca4-3181-408e-b9f6-4c436dc12a0a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:51:52.361930 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-0dd27ca4-3181-408e-b9f6-4c436dc12a0a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:51:52.369991 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0dd27ca4-3181-408e-b9f6-4c436dc12a0a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:52.370440 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0dd27ca4-3181-408e-b9f6-4c436dc12a0a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:52.371234 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0dd27ca4-3181-408e-b9f6-4c436dc12a0a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:52.371694 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0dd27ca4-3181-408e-b9f6-4c436dc12a0a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:52.528111 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.objects.instance [None req-0dd27ca4-3181-408e-b9f6-4c436dc12a0a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lazy-loading 'services' on Instance uuid 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962 {{(pid=113020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 27 03:51:52.782289 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-0dd27ca4-3181-408e-b9f6-4c436dc12a0a tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "DELETE /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/os-volume_attachments/9d4b8685-05fe-4943-b75c-10d6a69fcae7" status: 202 len: 0 microversion: 2.1 time: 0.425156 May 27 03:51:52.782890 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 705/1335] 10.222.0.25 () {58 vars in 1416 bytes} [Thu May 27 03:51:52 2021] DELETE /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962/os-volume_attachments/9d4b8685-05fe-4943-b75c-10d6a69fcae7 => generated 0 bytes in 427 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:51:54.339866 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-7233c5be-cfe0-478a-a124-123383052213 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:51:54.340331 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-7233c5be-cfe0-478a-a124-123383052213 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:51:54.347329 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-7233c5be-cfe0-478a-a124-123383052213 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:54.347777 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-7233c5be-cfe0-478a-a124-123383052213 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:54.348566 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-7233c5be-cfe0-478a-a124-123383052213 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:54.349002 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-7233c5be-cfe0-478a-a124-123383052213 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:54.410416 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-7233c5be-cfe0-478a-a124-123383052213 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Going to try to terminate instance {{(pid=113021) delete /opt/stack/nova/nova/compute/api.py:2539}} May 27 03:51:54.708305 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-7233c5be-cfe0-478a-a124-123383052213 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "DELETE /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962" status: 204 len: 0 microversion: 2.1 time: 0.371774 May 27 03:51:54.708854 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 631/1336] 10.222.0.25 () {58 vars in 1239 bytes} [Thu May 27 03:51:54 2021] DELETE /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 03:51:54.717533 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-7ce1e175-9da5-4874-aae9-52e50929f81f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:51:54.718233 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-7ce1e175-9da5-4874-aae9-52e50929f81f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:51:54.725719 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7ce1e175-9da5-4874-aae9-52e50929f81f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:54.726172 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7ce1e175-9da5-4874-aae9-52e50929f81f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:54.726957 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7ce1e175-9da5-4874-aae9-52e50929f81f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:54.727397 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7ce1e175-9da5-4874-aae9-52e50929f81f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:54.921145 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-7ce1e175-9da5-4874-aae9-52e50929f81f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:54.929881 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-7ce1e175-9da5-4874-aae9-52e50929f81f tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962" status: 200 len: 1674 microversion: 2.1 time: 0.216521 May 27 03:51:54.930445 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 706/1337] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:51:54 2021] GET /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962 => generated 1674 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:51:55.947928 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-27d1d26d-df07-498f-a4b5-41f28f198407 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:51:55.948716 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-27d1d26d-df07-498f-a4b5-41f28f198407 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:51:55.955952 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-27d1d26d-df07-498f-a4b5-41f28f198407 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:55.956445 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-27d1d26d-df07-498f-a4b5-41f28f198407 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:55.957789 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-27d1d26d-df07-498f-a4b5-41f28f198407 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:55.958232 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-27d1d26d-df07-498f-a4b5-41f28f198407 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:56.147962 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-27d1d26d-df07-498f-a4b5-41f28f198407 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:56.156373 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-27d1d26d-df07-498f-a4b5-41f28f198407 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962" status: 200 len: 1674 microversion: 2.1 time: 0.212573 May 27 03:51:56.156952 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 632/1338] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:51:55 2021] GET /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962 => generated 1674 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:51:57.174173 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-5a408cfc-c05f-4beb-a0ef-00109f2282f9 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:51:57.174742 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-5a408cfc-c05f-4beb-a0ef-00109f2282f9 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:51:57.182659 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-5a408cfc-c05f-4beb-a0ef-00109f2282f9 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:57.183103 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-5a408cfc-c05f-4beb-a0ef-00109f2282f9 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:57.183876 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-5a408cfc-c05f-4beb-a0ef-00109f2282f9 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:57.184311 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-5a408cfc-c05f-4beb-a0ef-00109f2282f9 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:57.385576 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-5a408cfc-c05f-4beb-a0ef-00109f2282f9 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:57.393802 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-5a408cfc-c05f-4beb-a0ef-00109f2282f9 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962" status: 200 len: 1674 microversion: 2.1 time: 0.224208 May 27 03:51:57.394470 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 707/1339] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:51:57 2021] GET /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962 => generated 1674 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:51:58.266452 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [req-ec7d1019-855a-420f-8c26-3c4b1abab99d req-2c099922-ff5d-41a5-962a-9b7450809847 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962", "name": "network-vif-deleted", "tag": "9d0a9265-835b-4677-b698-b6832076290d"}]} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:51:58.268060 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:51:58.268060 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: warnings.warn(msg) May 27 03:51:58.276873 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-ec7d1019-855a-420f-8c26-3c4b1abab99d req-2c099922-ff5d-41a5-962a-9b7450809847 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:58.277319 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-ec7d1019-855a-420f-8c26-3c4b1abab99d req-2c099922-ff5d-41a5-962a-9b7450809847 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:58.293407 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.compute.server_external_events [req-ec7d1019-855a-420f-8c26-3c4b1abab99d req-2c099922-ff5d-41a5-962a-9b7450809847 service nova] Creating event network-vif-deleted:9d0a9265-835b-4677-b698-b6832076290d for instance 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962 on hv-cinder-79326 May 27 03:51:58.298175 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [req-ec7d1019-855a-420f-8c26-3c4b1abab99d req-2c099922-ff5d-41a5-962a-9b7450809847 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035280 May 27 03:51:58.298762 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 633/1340] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:51:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:51:58.410922 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-1972cc5d-880d-472b-abaa-3b185ddd7186 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:51:58.412436 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-1972cc5d-880d-472b-abaa-3b185ddd7186 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:51:58.419788 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1972cc5d-880d-472b-abaa-3b185ddd7186 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:58.434193 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1972cc5d-880d-472b-abaa-3b185ddd7186 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:58.434193 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1972cc5d-880d-472b-abaa-3b185ddd7186 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:58.434193 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1972cc5d-880d-472b-abaa-3b185ddd7186 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:58.536452 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-1972cc5d-880d-472b-abaa-3b185ddd7186 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c1aa1f7c98f42c5a047354bef07b355', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276e81e3da1f4d4c9c1881d1b1e863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:51:58.544678 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-1972cc5d-880d-472b-abaa-3b185ddd7186 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962" status: 200 len: 1323 microversion: 2.1 time: 0.137517 May 27 03:51:58.545249 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 708/1341] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:51:58 2021] GET /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962 => generated 1323 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:51:59.562858 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-c9b9ba32-f5cd-4052-9a84-e1ea005304bf tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:51:59.563564 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-c9b9ba32-f5cd-4052-9a84-e1ea005304bf tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:51:59.571491 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c9b9ba32-f5cd-4052-9a84-e1ea005304bf tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:59.571949 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c9b9ba32-f5cd-4052-9a84-e1ea005304bf tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:59.572758 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c9b9ba32-f5cd-4052-9a84-e1ea005304bf tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:51:59.573201 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c9b9ba32-f5cd-4052-9a84-e1ea005304bf tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:51:59.624108 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.wsgi [None req-c9b9ba32-f5cd-4052-9a84-e1ea005304bf tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] HTTP exception thrown: Instance 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962 could not be found. May 27 03:51:59.624743 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-c9b9ba32-f5cd-4052-9a84-e1ea005304bf tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Returning 404 to user: Instance 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962 could not be found. {{(pid=113021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 27 03:51:59.625598 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-c9b9ba32-f5cd-4052-9a84-e1ea005304bf tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962" status: 404 len: 111 microversion: 2.1 time: 0.067015 May 27 03:51:59.626148 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 634/1342] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:51:59 2021] GET /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:51:59.635463 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-2e62300b-bc8d-499d-ac18-c1c3b5f67c19 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '.version_select at 0x7f98880c53a0>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:51:59.715227 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-2e62300b-bc8d-499d-ac18-c1c3b5f67c19 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1907301300" status: 202 len: 0 microversion: 2.1 time: 0.083820 May 27 03:51:59.715812 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 709/1343] 10.222.0.25 () {58 vars in 1221 bytes} [Thu May 27 03:51:59 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1907301300 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 27 03:52:03.561493 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-1df6ed03-f7f2-4eec-b9f3-3bd05f79c4ff tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:52:03.562025 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-1df6ed03-f7f2-4eec-b9f3-3bd05f79c4ff tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:52:03.569189 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1df6ed03-f7f2-4eec-b9f3-3bd05f79c4ff tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:52:03.569648 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1df6ed03-f7f2-4eec-b9f3-3bd05f79c4ff tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:52:03.570413 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1df6ed03-f7f2-4eec-b9f3-3bd05f79c4ff tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:52:03.570854 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1df6ed03-f7f2-4eec-b9f3-3bd05f79c4ff tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:52:03.619149 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.wsgi [None req-1df6ed03-f7f2-4eec-b9f3-3bd05f79c4ff tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] HTTP exception thrown: Instance 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962 could not be found. May 27 03:52:03.619745 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-1df6ed03-f7f2-4eec-b9f3-3bd05f79c4ff tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Returning 404 to user: Instance 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962 could not be found. {{(pid=113021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 27 03:52:03.620597 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-1df6ed03-f7f2-4eec-b9f3-3bd05f79c4ff tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "DELETE /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962" status: 404 len: 111 microversion: 2.1 time: 0.062788 May 27 03:52:03.621119 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 635/1344] 10.222.0.25 () {58 vars in 1239 bytes} [Thu May 27 03:52:03 2021] DELETE /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:52:03.628909 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-c81a5b25-b3df-4b31-a5bb-caffc05d0fe7 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:52:03.629527 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-c81a5b25-b3df-4b31-a5bb-caffc05d0fe7 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:52:03.636705 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c81a5b25-b3df-4b31-a5bb-caffc05d0fe7 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:52:03.637156 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c81a5b25-b3df-4b31-a5bb-caffc05d0fe7 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:52:03.637925 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c81a5b25-b3df-4b31-a5bb-caffc05d0fe7 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:52:03.638364 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c81a5b25-b3df-4b31-a5bb-caffc05d0fe7 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:52:03.686914 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.wsgi [None req-c81a5b25-b3df-4b31-a5bb-caffc05d0fe7 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] HTTP exception thrown: Instance 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962 could not be found. May 27 03:52:03.687501 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-c81a5b25-b3df-4b31-a5bb-caffc05d0fe7 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Returning 404 to user: Instance 51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962 could not be found. {{(pid=113020) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 27 03:52:03.688310 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-c81a5b25-b3df-4b31-a5bb-caffc05d0fe7 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962" status: 404 len: 111 microversion: 2.1 time: 0.063140 May 27 03:52:03.688866 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 710/1345] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:52:03 2021] GET /compute/v2.1/servers/51bd6d0c-e4d8-4f39-9db6-8fbce3bd8962 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:52:05.088516 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-955f33f5-328a-4d01-b3c8-227695406e3b tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:52:05.089027 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-955f33f5-328a-4d01-b3c8-227695406e3b tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:52:05.096253 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-955f33f5-328a-4d01-b3c8-227695406e3b tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:52:05.096774 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-955f33f5-328a-4d01-b3c8-227695406e3b tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:52:05.097554 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-955f33f5-328a-4d01-b3c8-227695406e3b tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:52:05.097994 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-955f33f5-328a-4d01-b3c8-227695406e3b tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:52:05.146134 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.wsgi [None req-955f33f5-328a-4d01-b3c8-227695406e3b tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] HTTP exception thrown: Instance 3c7e656a-afc5-4119-a11e-920c583d89d2 could not be found. May 27 03:52:05.146728 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-955f33f5-328a-4d01-b3c8-227695406e3b tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Returning 404 to user: Instance 3c7e656a-afc5-4119-a11e-920c583d89d2 could not be found. {{(pid=113021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 27 03:52:05.147562 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-955f33f5-328a-4d01-b3c8-227695406e3b tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 404 len: 111 microversion: 2.1 time: 0.062773 May 27 03:52:05.148094 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 636/1346] 10.222.0.25 () {58 vars in 1239 bytes} [Thu May 27 03:52:05 2021] DELETE /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:52:05.156127 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-3fa73f91-4fef-435b-8344-945301d43c54 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:52:05.156793 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-3fa73f91-4fef-435b-8344-945301d43c54 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] [instance: 3c7e656a-afc5-4119-a11e-920c583d89d2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:52:05.163961 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3fa73f91-4fef-435b-8344-945301d43c54 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:52:05.164427 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3fa73f91-4fef-435b-8344-945301d43c54 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:52:05.165208 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3fa73f91-4fef-435b-8344-945301d43c54 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:52:05.165651 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3fa73f91-4fef-435b-8344-945301d43c54 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:52:05.218072 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.wsgi [None req-3fa73f91-4fef-435b-8344-945301d43c54 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] HTTP exception thrown: Instance 3c7e656a-afc5-4119-a11e-920c583d89d2 could not be found. May 27 03:52:05.218702 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-3fa73f91-4fef-435b-8344-945301d43c54 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] Returning 404 to user: Instance 3c7e656a-afc5-4119-a11e-920c583d89d2 could not be found. {{(pid=113020) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 27 03:52:05.219534 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-3fa73f91-4fef-435b-8344-945301d43c54 tempest-AttachVolumeTestJSON-1260282656 tempest-AttachVolumeTestJSON-1260282656-project] 10.222.0.25 "GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2" status: 404 len: 111 microversion: 2.1 time: 0.067406 May 27 03:52:05.220113 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 711/1347] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:52:05 2021] GET /compute/v2.1/servers/3c7e656a-afc5-4119-a11e-920c583d89d2 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:52:12.787457 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-83155517-bf14-417f-bfc1-54e5295372c0 tempest-VolumesGetTestJSON-1372920146 tempest-VolumesGetTestJSON-1372920146-project] Action: 'create', calling method: .version_select at 0x7f9888115040>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1580503625", "metadata": {"Type": "work"}}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:52:13.442826 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-83155517-bf14-417f-bfc1-54e5295372c0 tempest-VolumesGetTestJSON-1372920146 tempest-VolumesGetTestJSON-1372920146-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.789702 May 27 03:52:13.443715 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 637/1348] 10.222.0.25 () {60 vars in 1156 bytes} [Thu May 27 03:52:12 2021] POST /compute/v2.1/os-volumes => generated 353 bytes in 791 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 27 03:52:13.462784 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-85d11305-bc35-4edd-bbbd-c951335d9c2e tempest-VolumesGetTestJSON-1372920146 tempest-VolumesGetTestJSON-1372920146-project] Calling method '.version_select at 0x7f988817f700>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:52:13.556911 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-85d11305-bc35-4edd-bbbd-c951335d9c2e tempest-VolumesGetTestJSON-1372920146 tempest-VolumesGetTestJSON-1372920146-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/603fcd97-c873-4288-88a1-b7ba90d04231" status: 200 len: 353 microversion: 2.1 time: 0.097658 May 27 03:52:13.561660 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 712/1349] 10.222.0.25 () {58 vars in 1245 bytes} [Thu May 27 03:52:13 2021] GET /compute/v2.1/os-volumes/603fcd97-c873-4288-88a1-b7ba90d04231 => generated 353 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:52:14.568887 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-4a2fc062-d233-4e45-af1c-b589886a06a3 tempest-VolumesGetTestJSON-1372920146 tempest-VolumesGetTestJSON-1372920146-project] Calling method '.version_select at 0x7f987bea09d0>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:52:14.657510 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-4a2fc062-d233-4e45-af1c-b589886a06a3 tempest-VolumesGetTestJSON-1372920146 tempest-VolumesGetTestJSON-1372920146-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/603fcd97-c873-4288-88a1-b7ba90d04231" status: 200 len: 354 microversion: 2.1 time: 0.092790 May 27 03:52:14.658059 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 638/1350] 10.222.0.25 () {58 vars in 1245 bytes} [Thu May 27 03:52:14 2021] GET /compute/v2.1/os-volumes/603fcd97-c873-4288-88a1-b7ba90d04231 => generated 354 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:52:14.668684 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-71247b1d-f2eb-4d2d-8968-5136b4d5d45a tempest-VolumesGetTestJSON-1372920146 tempest-VolumesGetTestJSON-1372920146-project] Calling method '.version_select at 0x7f9889be5550>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:52:14.757043 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-71247b1d-f2eb-4d2d-8968-5136b4d5d45a tempest-VolumesGetTestJSON-1372920146 tempest-VolumesGetTestJSON-1372920146-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/603fcd97-c873-4288-88a1-b7ba90d04231" status: 200 len: 354 microversion: 2.1 time: 0.091895 May 27 03:52:14.757632 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 713/1351] 10.222.0.25 () {58 vars in 1245 bytes} [Thu May 27 03:52:14 2021] GET /compute/v2.1/os-volumes/603fcd97-c873-4288-88a1-b7ba90d04231 => generated 354 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:52:14.773563 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-4da89864-e183-412a-9d1a-05859b7b66a2 tempest-VolumesGetTestJSON-1372920146 tempest-VolumesGetTestJSON-1372920146-project] Calling method '.version_select at 0x7f987bea0f70>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:52:14.993880 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-4da89864-e183-412a-9d1a-05859b7b66a2 tempest-VolumesGetTestJSON-1372920146 tempest-VolumesGetTestJSON-1372920146-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/603fcd97-c873-4288-88a1-b7ba90d04231" status: 202 len: 0 microversion: 2.1 time: 0.223844 May 27 03:52:14.994551 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 639/1352] 10.222.0.25 () {58 vars in 1248 bytes} [Thu May 27 03:52:14 2021] DELETE /compute/v2.1/os-volumes/603fcd97-c873-4288-88a1-b7ba90d04231 => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:52:15.003349 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-7ef3e55f-dc07-4763-8515-872aea68e6cb tempest-VolumesGetTestJSON-1372920146 tempest-VolumesGetTestJSON-1372920146-project] Calling method '.version_select at 0x7f988809daf0>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:52:15.092836 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-7ef3e55f-dc07-4763-8515-872aea68e6cb tempest-VolumesGetTestJSON-1372920146 tempest-VolumesGetTestJSON-1372920146-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/603fcd97-c873-4288-88a1-b7ba90d04231" status: 200 len: 353 microversion: 2.1 time: 0.093676 May 27 03:52:15.093403 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 714/1353] 10.222.0.25 () {58 vars in 1245 bytes} [Thu May 27 03:52:14 2021] GET /compute/v2.1/os-volumes/603fcd97-c873-4288-88a1-b7ba90d04231 => generated 353 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:52:16.105224 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-d407dec0-d798-44b3-bc78-1be5c322e815 tempest-VolumesGetTestJSON-1372920146 tempest-VolumesGetTestJSON-1372920146-project] Calling method '.version_select at 0x7f987be67160>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:52:16.166069 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.wsgi [None req-d407dec0-d798-44b3-bc78-1be5c322e815 tempest-VolumesGetTestJSON-1372920146 tempest-VolumesGetTestJSON-1372920146-project] HTTP exception thrown: Volume 603fcd97-c873-4288-88a1-b7ba90d04231 could not be found. May 27 03:52:16.166706 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-d407dec0-d798-44b3-bc78-1be5c322e815 tempest-VolumesGetTestJSON-1372920146 tempest-VolumesGetTestJSON-1372920146-project] Returning 404 to user: Volume 603fcd97-c873-4288-88a1-b7ba90d04231 could not be found. {{(pid=113021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 27 03:52:16.167557 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-d407dec0-d798-44b3-bc78-1be5c322e815 tempest-VolumesGetTestJSON-1372920146 tempest-VolumesGetTestJSON-1372920146-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/603fcd97-c873-4288-88a1-b7ba90d04231" status: 404 len: 109 microversion: 2.1 time: 0.066153 May 27 03:52:16.168083 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 640/1354] 10.222.0.25 () {58 vars in 1245 bytes} [Thu May 27 03:52:16 2021] GET /compute/v2.1/os-volumes/603fcd97-c873-4288-88a1-b7ba90d04231 => generated 109 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:52:36.096262 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-dbfcac80-96fd-4041-936e-a28becc908e3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:52:36.096809 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-dbfcac80-96fd-4041-936e-a28becc908e3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:52:36.104656 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-dbfcac80-96fd-4041-936e-a28becc908e3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:52:36.105111 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-dbfcac80-96fd-4041-936e-a28becc908e3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:52:36.105887 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-dbfcac80-96fd-4041-936e-a28becc908e3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:52:36.106325 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-dbfcac80-96fd-4041-936e-a28becc908e3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:52:36.165842 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-dbfcac80-96fd-4041-936e-a28becc908e3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Going to try to terminate instance {{(pid=113020) delete /opt/stack/nova/nova/compute/api.py:2539}} May 27 03:52:36.501656 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-dbfcac80-96fd-4041-936e-a28becc908e3 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "DELETE /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 204 len: 0 microversion: 2.20 time: 0.408911 May 27 03:52:36.502255 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 715/1355] 10.222.0.25 () {60 vars in 1280 bytes} [Thu May 27 03:52:36 2021] DELETE /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 27 03:52:36.511288 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-d14ebda3-17fc-4e36-a7b3-d7fd340824af tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:52:36.511906 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-d14ebda3-17fc-4e36-a7b3-d7fd340824af tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:52:36.519236 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d14ebda3-17fc-4e36-a7b3-d7fd340824af tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:52:36.519700 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d14ebda3-17fc-4e36-a7b3-d7fd340824af tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:52:36.520510 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d14ebda3-17fc-4e36-a7b3-d7fd340824af tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:52:36.520951 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d14ebda3-17fc-4e36-a7b3-d7fd340824af tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:52:36.717719 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-d14ebda3-17fc-4e36-a7b3-d7fd340824af tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:52:36.726391 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-d14ebda3-17fc-4e36-a7b3-d7fd340824af tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:52:36.727931 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-d14ebda3-17fc-4e36-a7b3-d7fd340824af tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:52:36.729103 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-d14ebda3-17fc-4e36-a7b3-d7fd340824af tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 200 len: 1723 microversion: 2.20 time: 0.222638 May 27 03:52:36.729661 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 641/1356] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:52:36 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 1723 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 03:52:37.748738 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-03d529dc-1373-494b-b682-21d0cf868fbb tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:52:37.749464 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-03d529dc-1373-494b-b682-21d0cf868fbb tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:52:37.764358 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-03d529dc-1373-494b-b682-21d0cf868fbb tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:52:37.764856 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-03d529dc-1373-494b-b682-21d0cf868fbb tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:52:37.765633 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-03d529dc-1373-494b-b682-21d0cf868fbb tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:52:37.766072 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-03d529dc-1373-494b-b682-21d0cf868fbb tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:52:37.977700 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-03d529dc-1373-494b-b682-21d0cf868fbb tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:52:37.986686 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-03d529dc-1373-494b-b682-21d0cf868fbb tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:52:37.989155 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-03d529dc-1373-494b-b682-21d0cf868fbb tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:52:37.989531 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-03d529dc-1373-494b-b682-21d0cf868fbb tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 200 len: 1723 microversion: 2.20 time: 0.244961 May 27 03:52:37.990094 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 716/1357] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:52:37 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 1723 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:52:39.007486 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-3c35c87b-6b0e-45ab-8681-4cd314d80054 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:52:39.008104 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-3c35c87b-6b0e-45ab-8681-4cd314d80054 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:52:39.016357 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-3c35c87b-6b0e-45ab-8681-4cd314d80054 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:52:39.016844 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-3c35c87b-6b0e-45ab-8681-4cd314d80054 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:52:39.017641 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-3c35c87b-6b0e-45ab-8681-4cd314d80054 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:52:39.018089 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-3c35c87b-6b0e-45ab-8681-4cd314d80054 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:52:39.314185 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-3c35c87b-6b0e-45ab-8681-4cd314d80054 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:52:39.326023 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-3c35c87b-6b0e-45ab-8681-4cd314d80054 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:52:39.326023 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-3c35c87b-6b0e-45ab-8681-4cd314d80054 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:52:39.326297 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-3c35c87b-6b0e-45ab-8681-4cd314d80054 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 200 len: 1723 microversion: 2.20 time: 0.322377 May 27 03:52:39.326638 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 642/1358] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:52:39 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 1723 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:52:40.086715 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [req-ee240a58-1d92-4ca2-bbcb-96ec996eb742 req-605139ee-dd17-473a-9cec-da84b1d76825 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaf24d29-a180-44ed-9549-e4cca130f813", "name": "network-vif-deleted", "tag": "99d7c768-f910-47b6-ae4b-dc6dede2eec8"}]} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:52:40.088437 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:52:40.088437 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: warnings.warn(msg) May 27 03:52:40.096852 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-ee240a58-1d92-4ca2-bbcb-96ec996eb742 req-605139ee-dd17-473a-9cec-da84b1d76825 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:52:40.097299 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-ee240a58-1d92-4ca2-bbcb-96ec996eb742 req-605139ee-dd17-473a-9cec-da84b1d76825 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:52:40.114477 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.compute.server_external_events [req-ee240a58-1d92-4ca2-bbcb-96ec996eb742 req-605139ee-dd17-473a-9cec-da84b1d76825 service nova] Creating event network-vif-deleted:99d7c768-f910-47b6-ae4b-dc6dede2eec8 for instance aaf24d29-a180-44ed-9549-e4cca130f813 on hv-cinder-79326 May 27 03:52:40.120237 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [req-ee240a58-1d92-4ca2-bbcb-96ec996eb742 req-605139ee-dd17-473a-9cec-da84b1d76825 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.177940 May 27 03:52:40.121317 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 717/1359] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:52:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:52:40.345781 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-1afd273a-d76a-4222-8d4f-03d84ffa8035 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:52:40.346329 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-1afd273a-d76a-4222-8d4f-03d84ffa8035 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:52:40.355379 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1afd273a-d76a-4222-8d4f-03d84ffa8035 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:52:40.355835 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1afd273a-d76a-4222-8d4f-03d84ffa8035 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:52:40.356674 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1afd273a-d76a-4222-8d4f-03d84ffa8035 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:52:40.357183 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1afd273a-d76a-4222-8d4f-03d84ffa8035 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:52:40.425584 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1afd273a-d76a-4222-8d4f-03d84ffa8035 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:52:40.426063 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1afd273a-d76a-4222-8d4f-03d84ffa8035 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:52:40.426562 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.objects.instance [None req-1afd273a-d76a-4222-8d4f-03d84ffa8035 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lazy-loading 'fault' on Instance uuid aaf24d29-a180-44ed-9549-e4cca130f813 {{(pid=113021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 27 03:52:40.556554 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-1afd273a-d76a-4222-8d4f-03d84ffa8035 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:52:40.565270 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-1afd273a-d76a-4222-8d4f-03d84ffa8035 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:52:40.566824 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-1afd273a-d76a-4222-8d4f-03d84ffa8035 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e44e0bf02c8a48b1a5bbbfd71f2281bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16ccb2756adb4055942bd0a0f0a061f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:52:40.567966 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-1afd273a-d76a-4222-8d4f-03d84ffa8035 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 200 len: 1371 microversion: 2.20 time: 0.226443 May 27 03:52:40.568546 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 643/1360] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:52:40 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 1371 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 03:52:41.586981 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-c5489ba7-dcbe-46f1-8e78-242f04aff5b4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:52:41.587678 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-c5489ba7-dcbe-46f1-8e78-242f04aff5b4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:52:41.595130 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c5489ba7-dcbe-46f1-8e78-242f04aff5b4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:52:41.595575 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c5489ba7-dcbe-46f1-8e78-242f04aff5b4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:52:41.596397 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c5489ba7-dcbe-46f1-8e78-242f04aff5b4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:52:41.596874 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c5489ba7-dcbe-46f1-8e78-242f04aff5b4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:52:41.645083 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.wsgi [None req-c5489ba7-dcbe-46f1-8e78-242f04aff5b4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] HTTP exception thrown: Instance aaf24d29-a180-44ed-9549-e4cca130f813 could not be found. May 27 03:52:41.645690 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-c5489ba7-dcbe-46f1-8e78-242f04aff5b4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Returning 404 to user: Instance aaf24d29-a180-44ed-9549-e4cca130f813 could not be found. {{(pid=113020) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 27 03:52:41.646514 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-c5489ba7-dcbe-46f1-8e78-242f04aff5b4 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 404 len: 111 microversion: 2.20 time: 0.064233 May 27 03:52:41.647051 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 718/1361] 10.222.0.25 () {60 vars in 1277 bytes} [Thu May 27 03:52:41 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 27 03:52:41.662836 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-5156a35e-8021-47f7-bd38-e01c95cd347f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '.version_select at 0x7f98881151f0>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:52:41.666960 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5156a35e-8021-47f7-bd38-e01c95cd347f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [99c49e49-84e2-41a1-b9c1-c3b329c816dc] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 27 03:52:42.685046 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO oslo.messaging._drivers.impl_rabbit [None req-5156a35e-8021-47f7-bd38-e01c95cd347f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [99c49e49-84e2-41a1-b9c1-c3b329c816dc] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 42030. May 27 03:52:42.765687 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-5156a35e-8021-47f7-bd38-e01c95cd347f tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1612966939" status: 204 len: 0 microversion: 2.20 time: 1.106411 May 27 03:52:42.766621 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 644/1362] 10.222.0.25 () {60 vars in 1262 bytes} [Thu May 27 03:52:41 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1612966939 => generated 0 bytes in 1108 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 27 03:52:45.532266 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-154a49de-7b4d-42b0-9a99-1dbfa5e6d328 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:52:45.532797 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-154a49de-7b4d-42b0-9a99-1dbfa5e6d328 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:52:45.540599 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-154a49de-7b4d-42b0-9a99-1dbfa5e6d328 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:52:45.541054 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-154a49de-7b4d-42b0-9a99-1dbfa5e6d328 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:52:45.541818 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-154a49de-7b4d-42b0-9a99-1dbfa5e6d328 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:52:45.542257 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-154a49de-7b4d-42b0-9a99-1dbfa5e6d328 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:52:45.589999 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.wsgi [None req-154a49de-7b4d-42b0-9a99-1dbfa5e6d328 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] HTTP exception thrown: Instance aaf24d29-a180-44ed-9549-e4cca130f813 could not be found. May 27 03:52:45.590590 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-154a49de-7b4d-42b0-9a99-1dbfa5e6d328 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Returning 404 to user: Instance aaf24d29-a180-44ed-9549-e4cca130f813 could not be found. {{(pid=113020) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 27 03:52:45.591410 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-154a49de-7b4d-42b0-9a99-1dbfa5e6d328 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "DELETE /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 404 len: 111 microversion: 2.1 time: 0.062839 May 27 03:52:45.591928 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 719/1363] 10.222.0.25 () {58 vars in 1239 bytes} [Thu May 27 03:52:45 2021] DELETE /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:52:45.599635 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-6cbd84a3-f388-4c7f-bd24-97a726e834ce tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:52:45.600247 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-6cbd84a3-f388-4c7f-bd24-97a726e834ce tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: aaf24d29-a180-44ed-9549-e4cca130f813] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:52:45.608565 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6cbd84a3-f388-4c7f-bd24-97a726e834ce tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:52:45.609019 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6cbd84a3-f388-4c7f-bd24-97a726e834ce tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:52:45.609782 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6cbd84a3-f388-4c7f-bd24-97a726e834ce tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:52:45.610224 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6cbd84a3-f388-4c7f-bd24-97a726e834ce tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:52:45.657531 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.wsgi [None req-6cbd84a3-f388-4c7f-bd24-97a726e834ce tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] HTTP exception thrown: Instance aaf24d29-a180-44ed-9549-e4cca130f813 could not be found. May 27 03:52:45.658109 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-6cbd84a3-f388-4c7f-bd24-97a726e834ce tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Returning 404 to user: Instance aaf24d29-a180-44ed-9549-e4cca130f813 could not be found. {{(pid=113021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 27 03:52:45.658916 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-6cbd84a3-f388-4c7f-bd24-97a726e834ce tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813" status: 404 len: 111 microversion: 2.1 time: 0.063031 May 27 03:52:45.659437 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 645/1364] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:52:45 2021] GET /compute/v2.1/servers/aaf24d29-a180-44ed-9549-e4cca130f813 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:52:47.047137 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-b20fb448-4d63-4728-90b4-de2671fa6952 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:52:47.047137 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-b20fb448-4d63-4728-90b4-de2671fa6952 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:52:47.047137 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b20fb448-4d63-4728-90b4-de2671fa6952 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:52:47.047137 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b20fb448-4d63-4728-90b4-de2671fa6952 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:52:47.047876 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b20fb448-4d63-4728-90b4-de2671fa6952 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:52:47.047876 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b20fb448-4d63-4728-90b4-de2671fa6952 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:52:47.096241 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.wsgi [None req-b20fb448-4d63-4728-90b4-de2671fa6952 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] HTTP exception thrown: Instance e367eb4b-29c5-4f41-b41d-0da84d751fe2 could not be found. May 27 03:52:47.096859 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-b20fb448-4d63-4728-90b4-de2671fa6952 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Returning 404 to user: Instance e367eb4b-29c5-4f41-b41d-0da84d751fe2 could not be found. {{(pid=113020) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 27 03:52:47.097678 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-b20fb448-4d63-4728-90b4-de2671fa6952 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 404 len: 111 microversion: 2.1 time: 0.064207 May 27 03:52:47.098211 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 720/1365] 10.222.0.25 () {58 vars in 1239 bytes} [Thu May 27 03:52:47 2021] DELETE /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:52:47.106500 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-2d0a738e-ddc0-4275-8fd4-b5e1ea925363 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:52:47.107125 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-2d0a738e-ddc0-4275-8fd4-b5e1ea925363 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] [instance: e367eb4b-29c5-4f41-b41d-0da84d751fe2] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:52:47.114199 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2d0a738e-ddc0-4275-8fd4-b5e1ea925363 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:52:47.114652 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2d0a738e-ddc0-4275-8fd4-b5e1ea925363 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:52:47.115438 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2d0a738e-ddc0-4275-8fd4-b5e1ea925363 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:52:47.115979 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-2d0a738e-ddc0-4275-8fd4-b5e1ea925363 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:52:47.167281 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.wsgi [None req-2d0a738e-ddc0-4275-8fd4-b5e1ea925363 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] HTTP exception thrown: Instance e367eb4b-29c5-4f41-b41d-0da84d751fe2 could not be found. May 27 03:52:47.167871 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-2d0a738e-ddc0-4275-8fd4-b5e1ea925363 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] Returning 404 to user: Instance e367eb4b-29c5-4f41-b41d-0da84d751fe2 could not be found. {{(pid=113021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 27 03:52:47.168722 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-2d0a738e-ddc0-4275-8fd4-b5e1ea925363 tempest-AttachVolumeShelveTestJSON-1972864967 tempest-AttachVolumeShelveTestJSON-1972864967-project] 10.222.0.25 "GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2" status: 404 len: 111 microversion: 2.1 time: 0.065832 May 27 03:52:47.169253 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 646/1366] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:52:47 2021] GET /compute/v2.1/servers/e367eb4b-29c5-4f41-b41d-0da84d751fe2 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:52:58.485854 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-63eb2815-07b0-4721-b43e-d31ed17197c0 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:52:58.486446 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-63eb2815-07b0-4721-b43e-d31ed17197c0 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: 8f32a2a3-7d2a-4396-8a34-0ebe6dda5782] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:52:58.493906 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-63eb2815-07b0-4721-b43e-d31ed17197c0 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:52:58.494358 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-63eb2815-07b0-4721-b43e-d31ed17197c0 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:52:58.495126 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-63eb2815-07b0-4721-b43e-d31ed17197c0 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:52:58.495560 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-63eb2815-07b0-4721-b43e-d31ed17197c0 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:52:58.558535 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-63eb2815-07b0-4721-b43e-d31ed17197c0 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: 8f32a2a3-7d2a-4396-8a34-0ebe6dda5782] Going to try to terminate instance {{(pid=113020) delete /opt/stack/nova/nova/compute/api.py:2539}} May 27 03:52:58.838736 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-63eb2815-07b0-4721-b43e-d31ed17197c0 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8f32a2a3-7d2a-4396-8a34-0ebe6dda5782" status: 204 len: 0 microversion: 2.1 time: 0.356326 May 27 03:52:58.839314 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 721/1367] 10.222.0.25 () {58 vars in 1239 bytes} [Thu May 27 03:52:58 2021] DELETE /compute/v2.1/servers/8f32a2a3-7d2a-4396-8a34-0ebe6dda5782 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 03:52:58.847097 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-f9d6409a-a73c-44f5-b597-3a3866197c5f tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:52:58.847740 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-f9d6409a-a73c-44f5-b597-3a3866197c5f tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: 8f32a2a3-7d2a-4396-8a34-0ebe6dda5782] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:52:58.855071 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f9d6409a-a73c-44f5-b597-3a3866197c5f tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:52:58.855527 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f9d6409a-a73c-44f5-b597-3a3866197c5f tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:52:58.856318 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f9d6409a-a73c-44f5-b597-3a3866197c5f tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:52:58.856788 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-f9d6409a-a73c-44f5-b597-3a3866197c5f tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:52:59.060720 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-f9d6409a-a73c-44f5-b597-3a3866197c5f tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fba01f5f17648a7a1fd0fbefd56e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6a582a2a304a7d881efcfa2373dfb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:52:59.069033 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-f9d6409a-a73c-44f5-b597-3a3866197c5f tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/8f32a2a3-7d2a-4396-8a34-0ebe6dda5782" status: 200 len: 1575 microversion: 2.1 time: 0.225613 May 27 03:52:59.069619 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 647/1368] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:52:58 2021] GET /compute/v2.1/servers/8f32a2a3-7d2a-4396-8a34-0ebe6dda5782 => generated 1575 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:53:00.086726 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-9c7955cf-9252-45d5-8720-181504cfd2fa tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:53:00.087343 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-9c7955cf-9252-45d5-8720-181504cfd2fa tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: 8f32a2a3-7d2a-4396-8a34-0ebe6dda5782] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:53:00.094512 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9c7955cf-9252-45d5-8720-181504cfd2fa tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:00.094957 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9c7955cf-9252-45d5-8720-181504cfd2fa tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:00.095715 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9c7955cf-9252-45d5-8720-181504cfd2fa tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:00.096147 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9c7955cf-9252-45d5-8720-181504cfd2fa tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:00.292418 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-9c7955cf-9252-45d5-8720-181504cfd2fa tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fba01f5f17648a7a1fd0fbefd56e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6a582a2a304a7d881efcfa2373dfb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:53:00.301547 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-9c7955cf-9252-45d5-8720-181504cfd2fa tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/8f32a2a3-7d2a-4396-8a34-0ebe6dda5782" status: 200 len: 1575 microversion: 2.1 time: 0.218623 May 27 03:53:00.302175 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 722/1369] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:53:00 2021] GET /compute/v2.1/servers/8f32a2a3-7d2a-4396-8a34-0ebe6dda5782 => generated 1575 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:53:01.320093 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-6f93a1d4-36dc-41a3-b56b-e4391c502d44 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:53:01.320743 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-6f93a1d4-36dc-41a3-b56b-e4391c502d44 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: 8f32a2a3-7d2a-4396-8a34-0ebe6dda5782] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:53:01.327869 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6f93a1d4-36dc-41a3-b56b-e4391c502d44 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:01.328324 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6f93a1d4-36dc-41a3-b56b-e4391c502d44 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:01.329130 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6f93a1d4-36dc-41a3-b56b-e4391c502d44 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:01.329568 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6f93a1d4-36dc-41a3-b56b-e4391c502d44 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:01.526705 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-6f93a1d4-36dc-41a3-b56b-e4391c502d44 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fba01f5f17648a7a1fd0fbefd56e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6a582a2a304a7d881efcfa2373dfb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:53:01.535428 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-6f93a1d4-36dc-41a3-b56b-e4391c502d44 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/8f32a2a3-7d2a-4396-8a34-0ebe6dda5782" status: 200 len: 1575 microversion: 2.1 time: 0.219925 May 27 03:53:01.535930 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 648/1370] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:53:01 2021] GET /compute/v2.1/servers/8f32a2a3-7d2a-4396-8a34-0ebe6dda5782 => generated 1575 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:53:02.552546 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-76df9a07-68f5-4910-887f-8b0b3aecfe90 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:53:02.555177 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-76df9a07-68f5-4910-887f-8b0b3aecfe90 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: 8f32a2a3-7d2a-4396-8a34-0ebe6dda5782] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:53:02.560497 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-76df9a07-68f5-4910-887f-8b0b3aecfe90 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:02.560949 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-76df9a07-68f5-4910-887f-8b0b3aecfe90 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:02.561719 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-76df9a07-68f5-4910-887f-8b0b3aecfe90 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:02.562155 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-76df9a07-68f5-4910-887f-8b0b3aecfe90 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:02.825212 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-76df9a07-68f5-4910-887f-8b0b3aecfe90 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fba01f5f17648a7a1fd0fbefd56e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6a582a2a304a7d881efcfa2373dfb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:53:02.833535 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-76df9a07-68f5-4910-887f-8b0b3aecfe90 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/8f32a2a3-7d2a-4396-8a34-0ebe6dda5782" status: 200 len: 1575 microversion: 2.1 time: 0.284725 May 27 03:53:02.834039 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 723/1371] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:53:02 2021] GET /compute/v2.1/servers/8f32a2a3-7d2a-4396-8a34-0ebe6dda5782 => generated 1575 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:53:03.850152 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-93c773d9-3266-4b16-8ebe-f71bbb791297 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:53:03.851263 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-93c773d9-3266-4b16-8ebe-f71bbb791297 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: 8f32a2a3-7d2a-4396-8a34-0ebe6dda5782] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:53:03.858704 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-93c773d9-3266-4b16-8ebe-f71bbb791297 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:03.859164 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-93c773d9-3266-4b16-8ebe-f71bbb791297 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:03.859941 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-93c773d9-3266-4b16-8ebe-f71bbb791297 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:03.860784 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-93c773d9-3266-4b16-8ebe-f71bbb791297 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:04.057578 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-93c773d9-3266-4b16-8ebe-f71bbb791297 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fba01f5f17648a7a1fd0fbefd56e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6a582a2a304a7d881efcfa2373dfb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:53:04.065791 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-93c773d9-3266-4b16-8ebe-f71bbb791297 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/8f32a2a3-7d2a-4396-8a34-0ebe6dda5782" status: 200 len: 1575 microversion: 2.1 time: 0.219305 May 27 03:53:04.066347 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 649/1372] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:53:03 2021] GET /compute/v2.1/servers/8f32a2a3-7d2a-4396-8a34-0ebe6dda5782 => generated 1575 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:53:05.082437 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-1f4ccb5f-c55f-4995-a318-6214d5d65558 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:53:05.083124 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-1f4ccb5f-c55f-4995-a318-6214d5d65558 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: 8f32a2a3-7d2a-4396-8a34-0ebe6dda5782] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:53:05.090758 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1f4ccb5f-c55f-4995-a318-6214d5d65558 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:05.091191 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1f4ccb5f-c55f-4995-a318-6214d5d65558 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:05.092004 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1f4ccb5f-c55f-4995-a318-6214d5d65558 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:05.092453 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-1f4ccb5f-c55f-4995-a318-6214d5d65558 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:05.396081 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-1f4ccb5f-c55f-4995-a318-6214d5d65558 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fba01f5f17648a7a1fd0fbefd56e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6a582a2a304a7d881efcfa2373dfb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:53:05.405115 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-1f4ccb5f-c55f-4995-a318-6214d5d65558 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/8f32a2a3-7d2a-4396-8a34-0ebe6dda5782" status: 200 len: 1575 microversion: 2.1 time: 0.326660 May 27 03:53:05.413098 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 724/1373] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:53:05 2021] GET /compute/v2.1/servers/8f32a2a3-7d2a-4396-8a34-0ebe6dda5782 => generated 1575 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:53:06.352898 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [req-2b1e52eb-c599-4fae-9c3e-686145949aae req-f9467f47-fa34-46ad-9517-17e1909d2077 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f32a2a3-7d2a-4396-8a34-0ebe6dda5782", "name": "network-vif-deleted", "tag": "a1a89af7-a2b7-41f6-9345-9a1eb1e228b0"}]} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:53:06.356214 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:53:06.356214 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: warnings.warn(msg) May 27 03:53:06.365475 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-2b1e52eb-c599-4fae-9c3e-686145949aae req-f9467f47-fa34-46ad-9517-17e1909d2077 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:06.367081 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-2b1e52eb-c599-4fae-9c3e-686145949aae req-f9467f47-fa34-46ad-9517-17e1909d2077 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:06.394220 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.compute.server_external_events [req-2b1e52eb-c599-4fae-9c3e-686145949aae req-f9467f47-fa34-46ad-9517-17e1909d2077 service nova] Creating event network-vif-deleted:a1a89af7-a2b7-41f6-9345-9a1eb1e228b0 for instance 8f32a2a3-7d2a-4396-8a34-0ebe6dda5782 on hv-cinder-79326 May 27 03:53:06.400267 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [req-2b1e52eb-c599-4fae-9c3e-686145949aae req-f9467f47-fa34-46ad-9517-17e1909d2077 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052292 May 27 03:53:06.400899 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 650/1374] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:53:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:53:06.422867 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-e9ca5bf2-601b-42b9-837d-061cea08e608 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:53:06.423551 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-e9ca5bf2-601b-42b9-837d-061cea08e608 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: 8f32a2a3-7d2a-4396-8a34-0ebe6dda5782] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:53:06.432143 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e9ca5bf2-601b-42b9-837d-061cea08e608 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:06.432673 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e9ca5bf2-601b-42b9-837d-061cea08e608 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:06.433487 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e9ca5bf2-601b-42b9-837d-061cea08e608 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:06.433922 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e9ca5bf2-601b-42b9-837d-061cea08e608 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:06.590002 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-e9ca5bf2-601b-42b9-837d-061cea08e608 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fba01f5f17648a7a1fd0fbefd56e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6a582a2a304a7d881efcfa2373dfb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:53:06.600366 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-e9ca5bf2-601b-42b9-837d-061cea08e608 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/8f32a2a3-7d2a-4396-8a34-0ebe6dda5782" status: 200 len: 1507 microversion: 2.1 time: 0.181583 May 27 03:53:06.602356 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 725/1375] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:53:06 2021] GET /compute/v2.1/servers/8f32a2a3-7d2a-4396-8a34-0ebe6dda5782 => generated 1507 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:53:07.619591 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-884862ca-e0f6-4da6-a0a3-1cdc6c42c5c3 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:53:07.621327 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-884862ca-e0f6-4da6-a0a3-1cdc6c42c5c3 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: 8f32a2a3-7d2a-4396-8a34-0ebe6dda5782] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:53:07.628994 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-884862ca-e0f6-4da6-a0a3-1cdc6c42c5c3 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:07.629499 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-884862ca-e0f6-4da6-a0a3-1cdc6c42c5c3 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:07.630266 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-884862ca-e0f6-4da6-a0a3-1cdc6c42c5c3 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:07.630709 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-884862ca-e0f6-4da6-a0a3-1cdc6c42c5c3 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:07.687303 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.wsgi [None req-884862ca-e0f6-4da6-a0a3-1cdc6c42c5c3 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] HTTP exception thrown: Instance 8f32a2a3-7d2a-4396-8a34-0ebe6dda5782 could not be found. May 27 03:53:07.687903 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-884862ca-e0f6-4da6-a0a3-1cdc6c42c5c3 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Returning 404 to user: Instance 8f32a2a3-7d2a-4396-8a34-0ebe6dda5782 could not be found. {{(pid=113021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 27 03:53:07.688764 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-884862ca-e0f6-4da6-a0a3-1cdc6c42c5c3 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/8f32a2a3-7d2a-4396-8a34-0ebe6dda5782" status: 404 len: 111 microversion: 2.1 time: 0.074074 May 27 03:53:07.689322 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 651/1376] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:53:07 2021] GET /compute/v2.1/servers/8f32a2a3-7d2a-4396-8a34-0ebe6dda5782 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:53:07.804810 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-98c61233-710d-4f2a-9735-b3adad9e3684 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1657307079", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-482559929", "security_groups": [{"name": "tempest-secgroup-smoke-1920270131"}], "block_device_mapping_v2": [{"uuid": "8f8e4acc-5a71-4854-bfef-3837cd8896aa", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e3d5c143-f0ba-4a03-b1d4-d1be1e83dd0f"}]}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:53:08.066262 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.network.neutron [None req-98c61233-710d-4f2a-9735-b3adad9e3684 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] validate_networks() for [('e3d5c143-f0ba-4a03-b1d4-d1be1e83dd0f', None, None, None)] {{(pid=113020) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 27 03:53:08.625008 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.virt.hardware [None req-98c61233-710d-4f2a-9735-b3adad9e3684 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Flavor limits 0:0:0 {{(pid=113020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 27 03:53:08.625434 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.virt.hardware [None req-98c61233-710d-4f2a-9735-b3adad9e3684 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Image limits 0:0:0 {{(pid=113020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 27 03:53:08.625941 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.virt.hardware [None req-98c61233-710d-4f2a-9735-b3adad9e3684 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Flavor pref 0:0:0 {{(pid=113020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 27 03:53:08.626350 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.virt.hardware [None req-98c61233-710d-4f2a-9735-b3adad9e3684 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Image pref 0:0:0 {{(pid=113020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 27 03:53:08.626765 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.virt.hardware [None req-98c61233-710d-4f2a-9735-b3adad9e3684 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=113020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 27 03:53:08.635601 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-98c61233-710d-4f2a-9735-b3adad9e3684 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:08.636069 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-98c61233-710d-4f2a-9735-b3adad9e3684 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:08.636913 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-98c61233-710d-4f2a-9735-b3adad9e3684 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:08.637348 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-98c61233-710d-4f2a-9735-b3adad9e3684 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:08.654057 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.quota [None req-98c61233-710d-4f2a-9735-b3adad9e3684 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Getting quotas for project 6b6a582a2a304a7d881efcfa2373dfb1. Resources: {'instances', 'cores', 'ram'} {{(pid=113020) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 27 03:53:08.658001 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.quota [None req-98c61233-710d-4f2a-9735-b3adad9e3684 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Getting quotas for user 4fba01f5f17648a7a1fd0fbefd56e046 and project 6b6a582a2a304a7d881efcfa2373dfb1. Resources: {'instances', 'cores', 'ram'} {{(pid=113020) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 27 03:53:08.758834 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-98c61233-710d-4f2a-9735-b3adad9e3684 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Going to run 1 instances... {{(pid=113020) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 27 03:53:08.760980 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-98c61233-710d-4f2a-9735-b3adad9e3684 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: 07cf1f8a-a1e3-4041-a5cc-8650aafb1468] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8f8e4acc-5a71-4854-bfef-3837cd8896aa',volume_size=None,volume_type=None)] {{(pid=113020) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 27 03:53:09.162213 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-98c61233-710d-4f2a-9735-b3adad9e3684 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.361462 May 27 03:53:09.164576 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 726/1377] 10.222.0.25 () {60 vars in 1147 bytes} [Thu May 27 03:53:07 2021] POST /compute/v2.1/servers => generated 406 bytes in 1365 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 03:53:09.173875 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-ae3b715f-057d-4fe0-b9fb-62adce62062b tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:53:09.175107 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-ae3b715f-057d-4fe0-b9fb-62adce62062b tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: 07cf1f8a-a1e3-4041-a5cc-8650aafb1468] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:53:09.334592 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-ae3b715f-057d-4fe0-b9fb-62adce62062b tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fba01f5f17648a7a1fd0fbefd56e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6a582a2a304a7d881efcfa2373dfb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:53:09.343680 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-ae3b715f-057d-4fe0-b9fb-62adce62062b tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/07cf1f8a-a1e3-4041-a5cc-8650aafb1468" status: 200 len: 1094 microversion: 2.1 time: 0.173779 May 27 03:53:09.345086 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 652/1378] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:53:09 2021] GET /compute/v2.1/servers/07cf1f8a-a1e3-4041-a5cc-8650aafb1468 => generated 1094 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:53:10.361690 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-362aad47-5c4b-4b61-b168-1e446724d4af tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:53:10.362481 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-362aad47-5c4b-4b61-b168-1e446724d4af tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: 07cf1f8a-a1e3-4041-a5cc-8650aafb1468] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:53:10.373769 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-362aad47-5c4b-4b61-b168-1e446724d4af tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:10.374227 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-362aad47-5c4b-4b61-b168-1e446724d4af tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:10.375019 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-362aad47-5c4b-4b61-b168-1e446724d4af tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:10.375458 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-362aad47-5c4b-4b61-b168-1e446724d4af tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:10.517706 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-362aad47-5c4b-4b61-b168-1e446724d4af tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fba01f5f17648a7a1fd0fbefd56e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6a582a2a304a7d881efcfa2373dfb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:53:10.526386 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-362aad47-5c4b-4b61-b168-1e446724d4af tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/07cf1f8a-a1e3-4041-a5cc-8650aafb1468" status: 200 len: 1144 microversion: 2.1 time: 0.168465 May 27 03:53:10.526951 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 727/1379] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:53:10 2021] GET /compute/v2.1/servers/07cf1f8a-a1e3-4041-a5cc-8650aafb1468 => generated 1144 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:53:11.552545 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-d0ebcbed-a480-4703-8a55-c4f4346fde34 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:53:11.553396 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-d0ebcbed-a480-4703-8a55-c4f4346fde34 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: 07cf1f8a-a1e3-4041-a5cc-8650aafb1468] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:53:11.561953 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d0ebcbed-a480-4703-8a55-c4f4346fde34 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:11.572723 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d0ebcbed-a480-4703-8a55-c4f4346fde34 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:11.572723 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d0ebcbed-a480-4703-8a55-c4f4346fde34 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:11.572723 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d0ebcbed-a480-4703-8a55-c4f4346fde34 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:11.846491 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-d0ebcbed-a480-4703-8a55-c4f4346fde34 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fba01f5f17648a7a1fd0fbefd56e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6a582a2a304a7d881efcfa2373dfb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:53:11.855805 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-d0ebcbed-a480-4703-8a55-c4f4346fde34 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/07cf1f8a-a1e3-4041-a5cc-8650aafb1468" status: 200 len: 1200 microversion: 2.1 time: 0.306946 May 27 03:53:11.865225 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 653/1380] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:53:11 2021] GET /compute/v2.1/servers/07cf1f8a-a1e3-4041-a5cc-8650aafb1468 => generated 1200 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:53:12.873431 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-a5805d8a-53eb-4313-b862-e628dc64b6fd tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:53:12.874044 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-a5805d8a-53eb-4313-b862-e628dc64b6fd tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: 07cf1f8a-a1e3-4041-a5cc-8650aafb1468] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:53:12.881360 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a5805d8a-53eb-4313-b862-e628dc64b6fd tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:12.881950 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a5805d8a-53eb-4313-b862-e628dc64b6fd tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:12.882757 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a5805d8a-53eb-4313-b862-e628dc64b6fd tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:12.883192 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a5805d8a-53eb-4313-b862-e628dc64b6fd tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:13.172866 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-a5805d8a-53eb-4313-b862-e628dc64b6fd tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fba01f5f17648a7a1fd0fbefd56e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6a582a2a304a7d881efcfa2373dfb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:53:13.184003 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-a5805d8a-53eb-4313-b862-e628dc64b6fd tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/07cf1f8a-a1e3-4041-a5cc-8650aafb1468" status: 200 len: 1278 microversion: 2.1 time: 0.314276 May 27 03:53:13.184682 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 728/1381] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:53:12 2021] GET /compute/v2.1/servers/07cf1f8a-a1e3-4041-a5cc-8650aafb1468 => generated 1278 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:53:14.153596 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [req-e4564fed-c6b3-406b-be28-7221c1d504ed req-2776e369-6017-4864-ac3c-0010cc79dac4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07cf1f8a-a1e3-4041-a5cc-8650aafb1468", "tag": "72f4926f-0769-4beb-af47-64edc4895b0c"}]} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:53:14.156256 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:53:14.156256 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: warnings.warn(msg) May 27 03:53:14.171553 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-e4564fed-c6b3-406b-be28-7221c1d504ed req-2776e369-6017-4864-ac3c-0010cc79dac4 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:14.172614 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-e4564fed-c6b3-406b-be28-7221c1d504ed req-2776e369-6017-4864-ac3c-0010cc79dac4 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:14.194303 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.compute.server_external_events [req-e4564fed-c6b3-406b-be28-7221c1d504ed req-2776e369-6017-4864-ac3c-0010cc79dac4 service nova] Creating event network-changed:72f4926f-0769-4beb-af47-64edc4895b0c for instance 07cf1f8a-a1e3-4041-a5cc-8650aafb1468 on hv-cinder-79326 May 27 03:53:14.200720 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-868b8497-4a7a-4655-ad3c-a8327b0ceca4 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:53:14.201876 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-868b8497-4a7a-4655-ad3c-a8327b0ceca4 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: 07cf1f8a-a1e3-4041-a5cc-8650aafb1468] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:53:14.204820 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [req-e4564fed-c6b3-406b-be28-7221c1d504ed req-2776e369-6017-4864-ac3c-0010cc79dac4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062469 May 27 03:53:14.204820 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 654/1382] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:53:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:53:14.213687 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-868b8497-4a7a-4655-ad3c-a8327b0ceca4 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:14.214133 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-868b8497-4a7a-4655-ad3c-a8327b0ceca4 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:14.214922 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-868b8497-4a7a-4655-ad3c-a8327b0ceca4 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:14.215385 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-868b8497-4a7a-4655-ad3c-a8327b0ceca4 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:14.487222 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-868b8497-4a7a-4655-ad3c-a8327b0ceca4 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fba01f5f17648a7a1fd0fbefd56e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6a582a2a304a7d881efcfa2373dfb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:53:14.496844 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-868b8497-4a7a-4655-ad3c-a8327b0ceca4 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/07cf1f8a-a1e3-4041-a5cc-8650aafb1468" status: 200 len: 1266 microversion: 2.1 time: 0.299738 May 27 03:53:14.497670 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 729/1383] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:53:14 2021] GET /compute/v2.1/servers/07cf1f8a-a1e3-4041-a5cc-8650aafb1468 => generated 1266 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:53:15.516013 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-3febdd73-1a2a-4ec0-936f-2c224385c8e4 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:53:15.516930 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-3febdd73-1a2a-4ec0-936f-2c224385c8e4 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: 07cf1f8a-a1e3-4041-a5cc-8650aafb1468] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:53:15.524485 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-3febdd73-1a2a-4ec0-936f-2c224385c8e4 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:15.525017 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-3febdd73-1a2a-4ec0-936f-2c224385c8e4 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:15.525868 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-3febdd73-1a2a-4ec0-936f-2c224385c8e4 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:15.526411 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-3febdd73-1a2a-4ec0-936f-2c224385c8e4 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:15.820243 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-3febdd73-1a2a-4ec0-936f-2c224385c8e4 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fba01f5f17648a7a1fd0fbefd56e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6a582a2a304a7d881efcfa2373dfb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:53:15.830607 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-3febdd73-1a2a-4ec0-936f-2c224385c8e4 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/07cf1f8a-a1e3-4041-a5cc-8650aafb1468" status: 200 len: 1266 microversion: 2.1 time: 0.318813 May 27 03:53:15.831184 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 655/1384] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:53:15 2021] GET /compute/v2.1/servers/07cf1f8a-a1e3-4041-a5cc-8650aafb1468 => generated 1266 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:53:16.846897 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-7d82b560-1342-41ce-94a3-1d8ba54fcff3 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:53:16.847519 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-7d82b560-1342-41ce-94a3-1d8ba54fcff3 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: 07cf1f8a-a1e3-4041-a5cc-8650aafb1468] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:53:16.854718 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7d82b560-1342-41ce-94a3-1d8ba54fcff3 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:16.855171 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7d82b560-1342-41ce-94a3-1d8ba54fcff3 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:16.855935 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7d82b560-1342-41ce-94a3-1d8ba54fcff3 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:16.856374 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7d82b560-1342-41ce-94a3-1d8ba54fcff3 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:17.142483 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-7d82b560-1342-41ce-94a3-1d8ba54fcff3 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fba01f5f17648a7a1fd0fbefd56e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6a582a2a304a7d881efcfa2373dfb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:53:17.151210 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-7d82b560-1342-41ce-94a3-1d8ba54fcff3 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/07cf1f8a-a1e3-4041-a5cc-8650aafb1468" status: 200 len: 1266 microversion: 2.1 time: 0.307989 May 27 03:53:17.151996 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 730/1385] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:53:16 2021] GET /compute/v2.1/servers/07cf1f8a-a1e3-4041-a5cc-8650aafb1468 => generated 1266 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:53:18.167264 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-98343434-ccc0-4790-afa4-ba14c5e1be72 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:53:18.167813 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-98343434-ccc0-4790-afa4-ba14c5e1be72 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: 07cf1f8a-a1e3-4041-a5cc-8650aafb1468] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:53:18.175085 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-98343434-ccc0-4790-afa4-ba14c5e1be72 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:18.175924 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-98343434-ccc0-4790-afa4-ba14c5e1be72 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:18.176440 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-98343434-ccc0-4790-afa4-ba14c5e1be72 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:18.176813 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-98343434-ccc0-4790-afa4-ba14c5e1be72 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:18.371386 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-98343434-ccc0-4790-afa4-ba14c5e1be72 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fba01f5f17648a7a1fd0fbefd56e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6a582a2a304a7d881efcfa2373dfb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:53:18.379446 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-98343434-ccc0-4790-afa4-ba14c5e1be72 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/07cf1f8a-a1e3-4041-a5cc-8650aafb1468" status: 200 len: 1266 microversion: 2.1 time: 0.215989 May 27 03:53:18.379998 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 656/1386] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:53:18 2021] GET /compute/v2.1/servers/07cf1f8a-a1e3-4041-a5cc-8650aafb1468 => generated 1266 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:53:19.396359 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-58c2aba0-764b-4a97-9fec-1044a5c2cc57 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:53:19.397157 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-58c2aba0-764b-4a97-9fec-1044a5c2cc57 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: 07cf1f8a-a1e3-4041-a5cc-8650aafb1468] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:53:19.405688 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-58c2aba0-764b-4a97-9fec-1044a5c2cc57 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:19.406139 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-58c2aba0-764b-4a97-9fec-1044a5c2cc57 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:19.406993 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-58c2aba0-764b-4a97-9fec-1044a5c2cc57 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:19.407431 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-58c2aba0-764b-4a97-9fec-1044a5c2cc57 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:19.603590 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-58c2aba0-764b-4a97-9fec-1044a5c2cc57 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fba01f5f17648a7a1fd0fbefd56e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6a582a2a304a7d881efcfa2373dfb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:53:19.611699 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-58c2aba0-764b-4a97-9fec-1044a5c2cc57 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/07cf1f8a-a1e3-4041-a5cc-8650aafb1468" status: 200 len: 1266 microversion: 2.1 time: 0.219032 May 27 03:53:19.612269 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 731/1387] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:53:19 2021] GET /compute/v2.1/servers/07cf1f8a-a1e3-4041-a5cc-8650aafb1468 => generated 1266 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:53:20.491107 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-011da963-5c79-429c-8a26-2ea419aea71c tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-429625824", "imageRef": "78c0913d-0e41-4b41-b38f-f45c4f2535ff", "flavorRef": "452", "networks": [{"uuid": "46de24cd-29cd-4b19-97dd-c1e473696501"}]}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:53:20.559070 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.network.neutron [None req-011da963-5c79-429c-8a26-2ea419aea71c tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] validate_networks() for [('46de24cd-29cd-4b19-97dd-c1e473696501', None, None, None)] {{(pid=113021) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 27 03:53:20.628136 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-a2dee2cd-07ea-41f7-a188-732b49597e6f tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:53:20.628717 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-a2dee2cd-07ea-41f7-a188-732b49597e6f tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: 07cf1f8a-a1e3-4041-a5cc-8650aafb1468] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:53:20.636069 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a2dee2cd-07ea-41f7-a188-732b49597e6f tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:20.648207 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a2dee2cd-07ea-41f7-a188-732b49597e6f tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:20.648207 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a2dee2cd-07ea-41f7-a188-732b49597e6f tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:20.648207 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a2dee2cd-07ea-41f7-a188-732b49597e6f tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:20.839791 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-a2dee2cd-07ea-41f7-a188-732b49597e6f tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fba01f5f17648a7a1fd0fbefd56e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6a582a2a304a7d881efcfa2373dfb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:53:20.848062 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-a2dee2cd-07ea-41f7-a188-732b49597e6f tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/07cf1f8a-a1e3-4041-a5cc-8650aafb1468" status: 200 len: 1266 microversion: 2.1 time: 0.223706 May 27 03:53:20.848755 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 732/1388] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:53:20 2021] GET /compute/v2.1/servers/07cf1f8a-a1e3-4041-a5cc-8650aafb1468 => generated 1266 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:53:21.202903 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.virt.hardware [None req-011da963-5c79-429c-8a26-2ea419aea71c tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Flavor limits 0:0:0 {{(pid=113021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 27 03:53:21.203334 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.virt.hardware [None req-011da963-5c79-429c-8a26-2ea419aea71c tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Image limits 0:0:0 {{(pid=113021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 27 03:53:21.203818 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.virt.hardware [None req-011da963-5c79-429c-8a26-2ea419aea71c tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Flavor pref 0:0:0 {{(pid=113021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 27 03:53:21.204231 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.virt.hardware [None req-011da963-5c79-429c-8a26-2ea419aea71c tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Image pref 0:0:0 {{(pid=113021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 27 03:53:21.204693 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.virt.hardware [None req-011da963-5c79-429c-8a26-2ea419aea71c tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=113021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 27 03:53:21.212943 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-011da963-5c79-429c-8a26-2ea419aea71c tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:21.213397 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-011da963-5c79-429c-8a26-2ea419aea71c tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:21.214204 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-011da963-5c79-429c-8a26-2ea419aea71c tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:21.214642 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-011da963-5c79-429c-8a26-2ea419aea71c tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:21.231256 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.quota [None req-011da963-5c79-429c-8a26-2ea419aea71c tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Getting quotas for project 3f42048e6086405bb0d27fd16d9a85d2. Resources: {'instances', 'cores', 'ram'} {{(pid=113021) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 27 03:53:21.235207 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.quota [None req-011da963-5c79-429c-8a26-2ea419aea71c tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Getting quotas for user 63ea32fdb1bc49aea23d70e94b58b9e1 and project 3f42048e6086405bb0d27fd16d9a85d2. Resources: {'instances', 'cores', 'ram'} {{(pid=113021) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 27 03:53:21.245954 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-011da963-5c79-429c-8a26-2ea419aea71c tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Going to run 1 instances... {{(pid=113021) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 27 03:53:21.248195 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-011da963-5c79-429c-8a26-2ea419aea71c tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] [instance: 37adb209-bfbe-4ecf-9577-00c220c30b77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78c0913d-0e41-4b41-b38f-f45c4f2535ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=113021) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 27 03:53:21.387417 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-011da963-5c79-429c-8a26-2ea419aea71c tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.899838 May 27 03:53:21.388133 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 657/1389] 10.222.0.25 () {60 vars in 1147 bytes} [Thu May 27 03:53:20 2021] POST /compute/v2.1/servers => generated 380 bytes in 901 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 03:53:21.397851 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-fcaa0e96-159b-4810-ab69-2e2216f87ac3 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:53:21.398549 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-fcaa0e96-159b-4810-ab69-2e2216f87ac3 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] [instance: 37adb209-bfbe-4ecf-9577-00c220c30b77] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:53:21.473462 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-fcaa0e96-159b-4810-ab69-2e2216f87ac3 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ea32fdb1bc49aea23d70e94b58b9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f42048e6086405bb0d27fd16d9a85d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:53:21.481125 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-fcaa0e96-159b-4810-ab69-2e2216f87ac3 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] 10.222.0.25 "GET /compute/v2.1/servers/37adb209-bfbe-4ecf-9577-00c220c30b77" status: 200 len: 1213 microversion: 2.1 time: 0.086716 May 27 03:53:21.481690 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 733/1390] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:53:21 2021] GET /compute/v2.1/servers/37adb209-bfbe-4ecf-9577-00c220c30b77 => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:53:21.864444 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-807da9a7-c127-41ea-9b91-2d001559db7f tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:53:21.865233 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-807da9a7-c127-41ea-9b91-2d001559db7f tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: 07cf1f8a-a1e3-4041-a5cc-8650aafb1468] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:53:21.873170 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-807da9a7-c127-41ea-9b91-2d001559db7f tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:21.873621 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-807da9a7-c127-41ea-9b91-2d001559db7f tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:21.874395 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-807da9a7-c127-41ea-9b91-2d001559db7f tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:21.874954 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-807da9a7-c127-41ea-9b91-2d001559db7f tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:22.084608 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-807da9a7-c127-41ea-9b91-2d001559db7f tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fba01f5f17648a7a1fd0fbefd56e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6a582a2a304a7d881efcfa2373dfb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:53:22.090751 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-807da9a7-c127-41ea-9b91-2d001559db7f tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/07cf1f8a-a1e3-4041-a5cc-8650aafb1468" status: 200 len: 1266 microversion: 2.1 time: 0.230511 May 27 03:53:22.091313 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 658/1391] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:53:21 2021] GET /compute/v2.1/servers/07cf1f8a-a1e3-4041-a5cc-8650aafb1468 => generated 1266 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:53:22.497666 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-3da18a1e-b452-478e-9a5c-d2fe9e14955d tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:53:22.498274 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-3da18a1e-b452-478e-9a5c-d2fe9e14955d tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] [instance: 37adb209-bfbe-4ecf-9577-00c220c30b77] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:53:22.508768 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3da18a1e-b452-478e-9a5c-d2fe9e14955d tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:22.512989 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3da18a1e-b452-478e-9a5c-d2fe9e14955d tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:22.512989 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3da18a1e-b452-478e-9a5c-d2fe9e14955d tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:22.512989 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3da18a1e-b452-478e-9a5c-d2fe9e14955d tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:22.620036 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-3da18a1e-b452-478e-9a5c-d2fe9e14955d tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ea32fdb1bc49aea23d70e94b58b9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f42048e6086405bb0d27fd16d9a85d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:53:22.628265 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-3da18a1e-b452-478e-9a5c-d2fe9e14955d tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] 10.222.0.25 "GET /compute/v2.1/servers/37adb209-bfbe-4ecf-9577-00c220c30b77" status: 200 len: 1217 microversion: 2.1 time: 0.134292 May 27 03:53:22.628862 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 734/1392] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:53:22 2021] GET /compute/v2.1/servers/37adb209-bfbe-4ecf-9577-00c220c30b77 => generated 1217 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:53:23.107076 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-44b58130-2ad5-46c1-821f-bbdbbd71a013 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:53:23.107691 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-44b58130-2ad5-46c1-821f-bbdbbd71a013 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: 07cf1f8a-a1e3-4041-a5cc-8650aafb1468] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:53:23.114976 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-44b58130-2ad5-46c1-821f-bbdbbd71a013 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:23.115448 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-44b58130-2ad5-46c1-821f-bbdbbd71a013 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:23.120477 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-44b58130-2ad5-46c1-821f-bbdbbd71a013 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:23.120477 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-44b58130-2ad5-46c1-821f-bbdbbd71a013 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:23.316960 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-44b58130-2ad5-46c1-821f-bbdbbd71a013 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fba01f5f17648a7a1fd0fbefd56e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6a582a2a304a7d881efcfa2373dfb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:53:23.325250 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-44b58130-2ad5-46c1-821f-bbdbbd71a013 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/07cf1f8a-a1e3-4041-a5cc-8650aafb1468" status: 200 len: 1266 microversion: 2.1 time: 0.221725 May 27 03:53:23.325953 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 659/1393] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:53:23 2021] GET /compute/v2.1/servers/07cf1f8a-a1e3-4041-a5cc-8650aafb1468 => generated 1266 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:53:23.644703 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-e9cf2b1e-fb50-4489-b772-70bddaa60887 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:53:23.645446 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-e9cf2b1e-fb50-4489-b772-70bddaa60887 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] [instance: 37adb209-bfbe-4ecf-9577-00c220c30b77] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:53:23.659468 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e9cf2b1e-fb50-4489-b772-70bddaa60887 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:23.660224 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e9cf2b1e-fb50-4489-b772-70bddaa60887 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:23.661339 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e9cf2b1e-fb50-4489-b772-70bddaa60887 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:23.662076 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e9cf2b1e-fb50-4489-b772-70bddaa60887 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:23.783769 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-e9cf2b1e-fb50-4489-b772-70bddaa60887 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ea32fdb1bc49aea23d70e94b58b9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f42048e6086405bb0d27fd16d9a85d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:53:23.794007 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-e9cf2b1e-fb50-4489-b772-70bddaa60887 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] 10.222.0.25 "GET /compute/v2.1/servers/37adb209-bfbe-4ecf-9577-00c220c30b77" status: 200 len: 1273 microversion: 2.1 time: 0.153440 May 27 03:53:23.795259 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 735/1394] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:53:23 2021] GET /compute/v2.1/servers/37adb209-bfbe-4ecf-9577-00c220c30b77 => generated 1273 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:53:24.342383 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-6ed8fe3a-4a5d-40cb-a4a9-1bb7907ff83d tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:53:24.343634 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-6ed8fe3a-4a5d-40cb-a4a9-1bb7907ff83d tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: 07cf1f8a-a1e3-4041-a5cc-8650aafb1468] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:53:24.352866 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6ed8fe3a-4a5d-40cb-a4a9-1bb7907ff83d tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:24.352866 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6ed8fe3a-4a5d-40cb-a4a9-1bb7907ff83d tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:24.353659 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6ed8fe3a-4a5d-40cb-a4a9-1bb7907ff83d tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:24.354184 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6ed8fe3a-4a5d-40cb-a4a9-1bb7907ff83d tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:24.702139 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-6ed8fe3a-4a5d-40cb-a4a9-1bb7907ff83d tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fba01f5f17648a7a1fd0fbefd56e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6a582a2a304a7d881efcfa2373dfb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:53:24.710246 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-6ed8fe3a-4a5d-40cb-a4a9-1bb7907ff83d tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/07cf1f8a-a1e3-4041-a5cc-8650aafb1468" status: 200 len: 1266 microversion: 2.1 time: 0.371615 May 27 03:53:24.710803 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 660/1395] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:53:24 2021] GET /compute/v2.1/servers/07cf1f8a-a1e3-4041-a5cc-8650aafb1468 => generated 1266 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:53:24.811447 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-9ac542cc-b882-4cc6-ba74-440f902221e2 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:53:24.812880 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-9ac542cc-b882-4cc6-ba74-440f902221e2 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] [instance: 37adb209-bfbe-4ecf-9577-00c220c30b77] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:53:24.821057 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9ac542cc-b882-4cc6-ba74-440f902221e2 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:24.821749 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9ac542cc-b882-4cc6-ba74-440f902221e2 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:24.822696 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9ac542cc-b882-4cc6-ba74-440f902221e2 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:24.823328 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-9ac542cc-b882-4cc6-ba74-440f902221e2 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:25.114445 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-9ac542cc-b882-4cc6-ba74-440f902221e2 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ea32fdb1bc49aea23d70e94b58b9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f42048e6086405bb0d27fd16d9a85d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:53:25.122704 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-9ac542cc-b882-4cc6-ba74-440f902221e2 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] 10.222.0.25 "GET /compute/v2.1/servers/37adb209-bfbe-4ecf-9577-00c220c30b77" status: 200 len: 1313 microversion: 2.1 time: 0.314986 May 27 03:53:25.123281 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 736/1396] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:53:24 2021] GET /compute/v2.1/servers/37adb209-bfbe-4ecf-9577-00c220c30b77 => generated 1313 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:53:25.726686 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-d3415b35-9ce0-4006-9a1c-ead3b1aa9617 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:53:25.727316 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-d3415b35-9ce0-4006-9a1c-ead3b1aa9617 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: 07cf1f8a-a1e3-4041-a5cc-8650aafb1468] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:53:25.734488 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d3415b35-9ce0-4006-9a1c-ead3b1aa9617 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:25.734950 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d3415b35-9ce0-4006-9a1c-ead3b1aa9617 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:25.735729 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d3415b35-9ce0-4006-9a1c-ead3b1aa9617 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:25.736180 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d3415b35-9ce0-4006-9a1c-ead3b1aa9617 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:26.019090 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-d3415b35-9ce0-4006-9a1c-ead3b1aa9617 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fba01f5f17648a7a1fd0fbefd56e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6a582a2a304a7d881efcfa2373dfb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:53:26.027862 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-d3415b35-9ce0-4006-9a1c-ead3b1aa9617 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/07cf1f8a-a1e3-4041-a5cc-8650aafb1468" status: 200 len: 1266 microversion: 2.1 time: 0.304842 May 27 03:53:26.028648 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 661/1397] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:53:25 2021] GET /compute/v2.1/servers/07cf1f8a-a1e3-4041-a5cc-8650aafb1468 => generated 1266 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:53:26.108524 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [req-829ca1fb-3f2d-46a4-b77c-3adcbe04d4b3 req-27c945eb-7dc5-4ed0-b7b4-508e9a9a5a0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37adb209-bfbe-4ecf-9577-00c220c30b77", "tag": "7d0fd87d-55fb-4a67-b8d0-d04b8a281e11"}]} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:53:26.111194 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:53:26.111194 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: warnings.warn(msg) May 27 03:53:26.121528 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-829ca1fb-3f2d-46a4-b77c-3adcbe04d4b3 req-27c945eb-7dc5-4ed0-b7b4-508e9a9a5a0d service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:26.123781 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-829ca1fb-3f2d-46a4-b77c-3adcbe04d4b3 req-27c945eb-7dc5-4ed0-b7b4-508e9a9a5a0d service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:26.138909 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-4f696634-9f92-4a67-a4ca-5999644cd64f tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:53:26.139850 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-4f696634-9f92-4a67-a4ca-5999644cd64f tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] [instance: 37adb209-bfbe-4ecf-9577-00c220c30b77] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:53:26.149565 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-4f696634-9f92-4a67-a4ca-5999644cd64f tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:26.150394 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-4f696634-9f92-4a67-a4ca-5999644cd64f tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:26.151412 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-4f696634-9f92-4a67-a4ca-5999644cd64f tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:26.152335 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-4f696634-9f92-4a67-a4ca-5999644cd64f tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:26.154857 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.compute.server_external_events [req-829ca1fb-3f2d-46a4-b77c-3adcbe04d4b3 req-27c945eb-7dc5-4ed0-b7b4-508e9a9a5a0d service nova] Creating event network-changed:7d0fd87d-55fb-4a67-b8d0-d04b8a281e11 for instance 37adb209-bfbe-4ecf-9577-00c220c30b77 on hv-cinder-79326 May 27 03:53:26.160015 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [req-829ca1fb-3f2d-46a4-b77c-3adcbe04d4b3 req-27c945eb-7dc5-4ed0-b7b4-508e9a9a5a0d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055068 May 27 03:53:26.161265 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 737/1398] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:53:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:53:26.608859 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-4f696634-9f92-4a67-a4ca-5999644cd64f tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ea32fdb1bc49aea23d70e94b58b9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f42048e6086405bb0d27fd16d9a85d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:53:26.617886 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-4f696634-9f92-4a67-a4ca-5999644cd64f tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] 10.222.0.25 "GET /compute/v2.1/servers/37adb209-bfbe-4ecf-9577-00c220c30b77" status: 200 len: 1313 microversion: 2.1 time: 0.482548 May 27 03:53:26.618465 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 662/1399] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:53:26 2021] GET /compute/v2.1/servers/37adb209-bfbe-4ecf-9577-00c220c30b77 => generated 1313 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:53:27.045251 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-5fb491ad-02ba-469a-a4d7-01cac88fe0f6 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:53:27.046069 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-5fb491ad-02ba-469a-a4d7-01cac88fe0f6 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: 07cf1f8a-a1e3-4041-a5cc-8650aafb1468] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:53:27.054037 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-5fb491ad-02ba-469a-a4d7-01cac88fe0f6 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:27.054648 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-5fb491ad-02ba-469a-a4d7-01cac88fe0f6 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:27.055605 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-5fb491ad-02ba-469a-a4d7-01cac88fe0f6 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:27.056046 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-5fb491ad-02ba-469a-a4d7-01cac88fe0f6 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:27.262805 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-5fb491ad-02ba-469a-a4d7-01cac88fe0f6 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fba01f5f17648a7a1fd0fbefd56e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6a582a2a304a7d881efcfa2373dfb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:53:27.271092 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-5fb491ad-02ba-469a-a4d7-01cac88fe0f6 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/07cf1f8a-a1e3-4041-a5cc-8650aafb1468" status: 200 len: 1266 microversion: 2.1 time: 0.230078 May 27 03:53:27.272039 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 738/1400] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:53:27 2021] GET /compute/v2.1/servers/07cf1f8a-a1e3-4041-a5cc-8650aafb1468 => generated 1266 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:53:27.634211 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-b29eb789-a3cc-4925-a693-f184fb5ed153 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:53:27.634986 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-b29eb789-a3cc-4925-a693-f184fb5ed153 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] [instance: 37adb209-bfbe-4ecf-9577-00c220c30b77] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:53:27.642143 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b29eb789-a3cc-4925-a693-f184fb5ed153 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:27.642593 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b29eb789-a3cc-4925-a693-f184fb5ed153 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:27.643354 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b29eb789-a3cc-4925-a693-f184fb5ed153 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:27.643789 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b29eb789-a3cc-4925-a693-f184fb5ed153 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:27.846127 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-b29eb789-a3cc-4925-a693-f184fb5ed153 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ea32fdb1bc49aea23d70e94b58b9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f42048e6086405bb0d27fd16d9a85d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:53:27.854914 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-b29eb789-a3cc-4925-a693-f184fb5ed153 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] 10.222.0.25 "GET /compute/v2.1/servers/37adb209-bfbe-4ecf-9577-00c220c30b77" status: 200 len: 1313 microversion: 2.1 time: 0.224345 May 27 03:53:27.855529 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 663/1401] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:53:27 2021] GET /compute/v2.1/servers/37adb209-bfbe-4ecf-9577-00c220c30b77 => generated 1313 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:53:28.289513 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-8fc29ddf-2ce9-42f7-8415-ec44b14a81dd tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:53:28.294080 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-8fc29ddf-2ce9-42f7-8415-ec44b14a81dd tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: 07cf1f8a-a1e3-4041-a5cc-8650aafb1468] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:53:28.298721 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8fc29ddf-2ce9-42f7-8415-ec44b14a81dd tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:28.299434 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8fc29ddf-2ce9-42f7-8415-ec44b14a81dd tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:28.300322 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8fc29ddf-2ce9-42f7-8415-ec44b14a81dd tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:28.300894 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8fc29ddf-2ce9-42f7-8415-ec44b14a81dd tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:28.469709 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [req-08fa9c87-162d-4c7c-a609-dacafca5590d req-94bec547-326c-45d4-b721-32af3398e1ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07cf1f8a-a1e3-4041-a5cc-8650aafb1468", "name": "network-vif-plugged", "status": "completed", "tag": "72f4926f-0769-4beb-af47-64edc4895b0c"}]} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:53:28.471938 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:53:28.471938 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: warnings.warn(msg) May 27 03:53:28.484751 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-08fa9c87-162d-4c7c-a609-dacafca5590d req-94bec547-326c-45d4-b721-32af3398e1ca service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:28.485403 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-08fa9c87-162d-4c7c-a609-dacafca5590d req-94bec547-326c-45d4-b721-32af3398e1ca service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:28.502592 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.compute.server_external_events [req-08fa9c87-162d-4c7c-a609-dacafca5590d req-94bec547-326c-45d4-b721-32af3398e1ca service nova] Creating event network-vif-plugged:72f4926f-0769-4beb-af47-64edc4895b0c for instance 07cf1f8a-a1e3-4041-a5cc-8650aafb1468 on hv-cinder-79326 May 27 03:53:28.503042 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-8fc29ddf-2ce9-42f7-8415-ec44b14a81dd tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fba01f5f17648a7a1fd0fbefd56e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6a582a2a304a7d881efcfa2373dfb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:53:28.507898 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [req-08fa9c87-162d-4c7c-a609-dacafca5590d req-94bec547-326c-45d4-b721-32af3398e1ca service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.256013 May 27 03:53:28.508526 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 739/1402] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:53:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:53:28.514136 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-8fc29ddf-2ce9-42f7-8415-ec44b14a81dd tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/07cf1f8a-a1e3-4041-a5cc-8650aafb1468" status: 200 len: 1266 microversion: 2.1 time: 0.229391 May 27 03:53:28.514705 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 664/1403] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:53:28 2021] GET /compute/v2.1/servers/07cf1f8a-a1e3-4041-a5cc-8650aafb1468 => generated 1266 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:53:28.873091 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-6e8916a2-d840-4f91-9ef4-c4730c042d6b tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:53:28.873801 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-6e8916a2-d840-4f91-9ef4-c4730c042d6b tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] [instance: 37adb209-bfbe-4ecf-9577-00c220c30b77] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:53:28.882625 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6e8916a2-d840-4f91-9ef4-c4730c042d6b tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:28.883161 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6e8916a2-d840-4f91-9ef4-c4730c042d6b tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:28.883855 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6e8916a2-d840-4f91-9ef4-c4730c042d6b tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:28.884287 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6e8916a2-d840-4f91-9ef4-c4730c042d6b tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:29.094859 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-6e8916a2-d840-4f91-9ef4-c4730c042d6b tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ea32fdb1bc49aea23d70e94b58b9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f42048e6086405bb0d27fd16d9a85d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:53:29.103053 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-6e8916a2-d840-4f91-9ef4-c4730c042d6b tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] 10.222.0.25 "GET /compute/v2.1/servers/37adb209-bfbe-4ecf-9577-00c220c30b77" status: 200 len: 1313 microversion: 2.1 time: 0.235164 May 27 03:53:29.103617 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 740/1404] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:53:28 2021] GET /compute/v2.1/servers/37adb209-bfbe-4ecf-9577-00c220c30b77 => generated 1313 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:53:29.531313 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-3116a3ec-c0b7-4255-8e7a-3a7bd81a6fef tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:53:29.532110 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-3116a3ec-c0b7-4255-8e7a-3a7bd81a6fef tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: 07cf1f8a-a1e3-4041-a5cc-8650aafb1468] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:53:29.539986 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-3116a3ec-c0b7-4255-8e7a-3a7bd81a6fef tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:29.540675 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-3116a3ec-c0b7-4255-8e7a-3a7bd81a6fef tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:29.541458 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-3116a3ec-c0b7-4255-8e7a-3a7bd81a6fef tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:29.541892 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-3116a3ec-c0b7-4255-8e7a-3a7bd81a6fef tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:29.810953 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-3116a3ec-c0b7-4255-8e7a-3a7bd81a6fef tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fba01f5f17648a7a1fd0fbefd56e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6a582a2a304a7d881efcfa2373dfb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:53:29.819677 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-3116a3ec-c0b7-4255-8e7a-3a7bd81a6fef tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/07cf1f8a-a1e3-4041-a5cc-8650aafb1468" status: 200 len: 1266 microversion: 2.1 time: 0.291903 May 27 03:53:29.823009 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 665/1405] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:53:29 2021] GET /compute/v2.1/servers/07cf1f8a-a1e3-4041-a5cc-8650aafb1468 => generated 1266 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:53:30.119693 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-e1f5365f-91c0-4388-883b-3bcad8c2edf6 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:53:30.121671 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-e1f5365f-91c0-4388-883b-3bcad8c2edf6 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] [instance: 37adb209-bfbe-4ecf-9577-00c220c30b77] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:53:30.129993 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e1f5365f-91c0-4388-883b-3bcad8c2edf6 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:30.130682 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e1f5365f-91c0-4388-883b-3bcad8c2edf6 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:30.131806 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e1f5365f-91c0-4388-883b-3bcad8c2edf6 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:30.132479 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e1f5365f-91c0-4388-883b-3bcad8c2edf6 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:30.342942 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-e1f5365f-91c0-4388-883b-3bcad8c2edf6 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ea32fdb1bc49aea23d70e94b58b9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f42048e6086405bb0d27fd16d9a85d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:53:30.351932 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-e1f5365f-91c0-4388-883b-3bcad8c2edf6 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] 10.222.0.25 "GET /compute/v2.1/servers/37adb209-bfbe-4ecf-9577-00c220c30b77" status: 200 len: 1313 microversion: 2.1 time: 0.236091 May 27 03:53:30.352519 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 741/1406] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:53:30 2021] GET /compute/v2.1/servers/37adb209-bfbe-4ecf-9577-00c220c30b77 => generated 1313 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:53:30.836863 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-61f9b475-dac2-40fb-b083-04b97ae8cc1a tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:53:30.837507 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-61f9b475-dac2-40fb-b083-04b97ae8cc1a tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: 07cf1f8a-a1e3-4041-a5cc-8650aafb1468] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:53:30.844727 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-61f9b475-dac2-40fb-b083-04b97ae8cc1a tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:30.845182 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-61f9b475-dac2-40fb-b083-04b97ae8cc1a tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:30.845959 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-61f9b475-dac2-40fb-b083-04b97ae8cc1a tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:30.846394 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-61f9b475-dac2-40fb-b083-04b97ae8cc1a tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:31.112358 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-61f9b475-dac2-40fb-b083-04b97ae8cc1a tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fba01f5f17648a7a1fd0fbefd56e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6a582a2a304a7d881efcfa2373dfb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:53:31.120970 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-61f9b475-dac2-40fb-b083-04b97ae8cc1a tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/07cf1f8a-a1e3-4041-a5cc-8650aafb1468" status: 200 len: 1453 microversion: 2.1 time: 0.288643 May 27 03:53:31.121541 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 666/1407] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:53:30 2021] GET /compute/v2.1/servers/07cf1f8a-a1e3-4041-a5cc-8650aafb1468 => generated 1453 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:53:31.137214 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-b2b5d861-1cab-4428-964f-1a819c3170c4 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:53:31.138055 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-b2b5d861-1cab-4428-964f-1a819c3170c4 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: 07cf1f8a-a1e3-4041-a5cc-8650aafb1468] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:53:31.145189 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b2b5d861-1cab-4428-964f-1a819c3170c4 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:31.145636 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b2b5d861-1cab-4428-964f-1a819c3170c4 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:31.146397 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b2b5d861-1cab-4428-964f-1a819c3170c4 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:31.146833 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b2b5d861-1cab-4428-964f-1a819c3170c4 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:31.368756 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-e07b600d-4619-43ed-86c3-8ce34929478c tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:53:31.369375 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-e07b600d-4619-43ed-86c3-8ce34929478c tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] [instance: 37adb209-bfbe-4ecf-9577-00c220c30b77] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:53:31.377004 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e07b600d-4619-43ed-86c3-8ce34929478c tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:31.377686 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e07b600d-4619-43ed-86c3-8ce34929478c tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:31.378476 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e07b600d-4619-43ed-86c3-8ce34929478c tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:31.378914 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e07b600d-4619-43ed-86c3-8ce34929478c tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:31.443988 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-b2b5d861-1cab-4428-964f-1a819c3170c4 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fba01f5f17648a7a1fd0fbefd56e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6a582a2a304a7d881efcfa2373dfb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:53:31.452662 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-b2b5d861-1cab-4428-964f-1a819c3170c4 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/07cf1f8a-a1e3-4041-a5cc-8650aafb1468" status: 200 len: 1453 microversion: 2.1 time: 0.319116 May 27 03:53:31.453471 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 742/1408] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:53:31 2021] GET /compute/v2.1/servers/07cf1f8a-a1e3-4041-a5cc-8650aafb1468 => generated 1453 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:53:31.587026 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-e07b600d-4619-43ed-86c3-8ce34929478c tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ea32fdb1bc49aea23d70e94b58b9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f42048e6086405bb0d27fd16d9a85d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:53:31.595275 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-e07b600d-4619-43ed-86c3-8ce34929478c tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] 10.222.0.25 "GET /compute/v2.1/servers/37adb209-bfbe-4ecf-9577-00c220c30b77" status: 200 len: 1313 microversion: 2.1 time: 0.230796 May 27 03:53:31.596384 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 667/1409] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:53:31 2021] GET /compute/v2.1/servers/37adb209-bfbe-4ecf-9577-00c220c30b77 => generated 1313 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:53:32.322494 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [req-3102213e-ca22-4208-a055-293813082dd8 req-d96f846f-6e74-493d-ac1f-f7fcafac8974 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37adb209-bfbe-4ecf-9577-00c220c30b77", "name": "network-vif-plugged", "status": "completed", "tag": "7d0fd87d-55fb-4a67-b8d0-d04b8a281e11"}]} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:53:32.324797 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:53:32.324797 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: warnings.warn(msg) May 27 03:53:32.333572 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-3102213e-ca22-4208-a055-293813082dd8 req-d96f846f-6e74-493d-ac1f-f7fcafac8974 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:32.334017 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-3102213e-ca22-4208-a055-293813082dd8 req-d96f846f-6e74-493d-ac1f-f7fcafac8974 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:32.351181 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.compute.server_external_events [req-3102213e-ca22-4208-a055-293813082dd8 req-d96f846f-6e74-493d-ac1f-f7fcafac8974 service nova] Creating event network-vif-plugged:7d0fd87d-55fb-4a67-b8d0-d04b8a281e11 for instance 37adb209-bfbe-4ecf-9577-00c220c30b77 on hv-cinder-79326 May 27 03:53:32.356622 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [req-3102213e-ca22-4208-a055-293813082dd8 req-d96f846f-6e74-493d-ac1f-f7fcafac8974 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038399 May 27 03:53:32.357813 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 743/1410] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:53:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:53:32.613019 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-7b175177-d9fc-41f5-a177-b8b9581f8920 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:53:32.613631 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-7b175177-d9fc-41f5-a177-b8b9581f8920 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] [instance: 37adb209-bfbe-4ecf-9577-00c220c30b77] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:53:32.621710 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-7b175177-d9fc-41f5-a177-b8b9581f8920 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:32.622167 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-7b175177-d9fc-41f5-a177-b8b9581f8920 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:32.622935 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-7b175177-d9fc-41f5-a177-b8b9581f8920 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:32.623372 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-7b175177-d9fc-41f5-a177-b8b9581f8920 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:32.908520 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-7b175177-d9fc-41f5-a177-b8b9581f8920 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ea32fdb1bc49aea23d70e94b58b9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f42048e6086405bb0d27fd16d9a85d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:53:32.916701 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-7b175177-d9fc-41f5-a177-b8b9581f8920 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] 10.222.0.25 "GET /compute/v2.1/servers/37adb209-bfbe-4ecf-9577-00c220c30b77" status: 200 len: 1313 microversion: 2.1 time: 0.307457 May 27 03:53:32.917275 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 668/1411] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:53:32 2021] GET /compute/v2.1/servers/37adb209-bfbe-4ecf-9577-00c220c30b77 => generated 1313 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:53:33.933773 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-3c787678-030c-407d-a6e5-7e49485bf37b tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:53:33.934483 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-3c787678-030c-407d-a6e5-7e49485bf37b tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] [instance: 37adb209-bfbe-4ecf-9577-00c220c30b77] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:53:33.942214 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3c787678-030c-407d-a6e5-7e49485bf37b tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:33.942675 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3c787678-030c-407d-a6e5-7e49485bf37b tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:33.943458 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3c787678-030c-407d-a6e5-7e49485bf37b tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:33.943899 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3c787678-030c-407d-a6e5-7e49485bf37b tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:34.357460 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-3c787678-030c-407d-a6e5-7e49485bf37b tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ea32fdb1bc49aea23d70e94b58b9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f42048e6086405bb0d27fd16d9a85d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:53:34.365639 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-3c787678-030c-407d-a6e5-7e49485bf37b tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] 10.222.0.25 "GET /compute/v2.1/servers/37adb209-bfbe-4ecf-9577-00c220c30b77" status: 200 len: 1313 microversion: 2.1 time: 0.436044 May 27 03:53:34.366234 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 744/1412] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:53:33 2021] GET /compute/v2.1/servers/37adb209-bfbe-4ecf-9577-00c220c30b77 => generated 1313 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:53:34.466390 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [req-769f3f4b-9150-4d0c-9303-fcb23bd1563c req-2ad4d718-f8fc-4395-b375-e54d58d52196 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07cf1f8a-a1e3-4041-a5cc-8650aafb1468", "tag": "72f4926f-0769-4beb-af47-64edc4895b0c"}]} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:53:34.467994 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:53:34.467994 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: warnings.warn(msg) May 27 03:53:34.476319 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-769f3f4b-9150-4d0c-9303-fcb23bd1563c req-2ad4d718-f8fc-4395-b375-e54d58d52196 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:34.476786 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-769f3f4b-9150-4d0c-9303-fcb23bd1563c req-2ad4d718-f8fc-4395-b375-e54d58d52196 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:34.492843 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.compute.server_external_events [req-769f3f4b-9150-4d0c-9303-fcb23bd1563c req-2ad4d718-f8fc-4395-b375-e54d58d52196 service nova] Creating event network-changed:72f4926f-0769-4beb-af47-64edc4895b0c for instance 07cf1f8a-a1e3-4041-a5cc-8650aafb1468 on hv-cinder-79326 May 27 03:53:34.497916 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [req-769f3f4b-9150-4d0c-9303-fcb23bd1563c req-2ad4d718-f8fc-4395-b375-e54d58d52196 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035164 May 27 03:53:34.498501 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 669/1413] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:53:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:53:35.382078 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-ce2eb8e4-5a6c-4f08-ae7e-202db03f4a2d tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:53:35.382701 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-ce2eb8e4-5a6c-4f08-ae7e-202db03f4a2d tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] [instance: 37adb209-bfbe-4ecf-9577-00c220c30b77] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:53:35.390457 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ce2eb8e4-5a6c-4f08-ae7e-202db03f4a2d tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:35.390877 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ce2eb8e4-5a6c-4f08-ae7e-202db03f4a2d tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:35.391668 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ce2eb8e4-5a6c-4f08-ae7e-202db03f4a2d tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:35.392117 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ce2eb8e4-5a6c-4f08-ae7e-202db03f4a2d tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:35.602330 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-ce2eb8e4-5a6c-4f08-ae7e-202db03f4a2d tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ea32fdb1bc49aea23d70e94b58b9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f42048e6086405bb0d27fd16d9a85d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:53:35.610918 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-ce2eb8e4-5a6c-4f08-ae7e-202db03f4a2d tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] 10.222.0.25 "GET /compute/v2.1/servers/37adb209-bfbe-4ecf-9577-00c220c30b77" status: 200 len: 1496 microversion: 2.1 time: 0.232563 May 27 03:53:35.611610 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 745/1414] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:53:35 2021] GET /compute/v2.1/servers/37adb209-bfbe-4ecf-9577-00c220c30b77 => generated 1496 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:53:40.216563 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-3433eac3-97bf-46da-b598-ce8b0bd7fcf3 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:53:40.217158 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-3433eac3-97bf-46da-b598-ce8b0bd7fcf3 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] [instance: 37adb209-bfbe-4ecf-9577-00c220c30b77] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:53:40.224583 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-3433eac3-97bf-46da-b598-ce8b0bd7fcf3 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:40.225035 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-3433eac3-97bf-46da-b598-ce8b0bd7fcf3 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:40.226453 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-3433eac3-97bf-46da-b598-ce8b0bd7fcf3 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:40.226898 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-3433eac3-97bf-46da-b598-ce8b0bd7fcf3 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:40.285881 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-3433eac3-97bf-46da-b598-ce8b0bd7fcf3 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] [instance: 37adb209-bfbe-4ecf-9577-00c220c30b77] Going to try to terminate instance {{(pid=113021) delete /opt/stack/nova/nova/compute/api.py:2539}} May 27 03:53:40.735016 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-3433eac3-97bf-46da-b598-ce8b0bd7fcf3 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] 10.222.0.25 "DELETE /compute/v2.1/servers/37adb209-bfbe-4ecf-9577-00c220c30b77" status: 204 len: 0 microversion: 2.1 time: 0.522229 May 27 03:53:40.735995 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 670/1415] 10.222.0.25 () {58 vars in 1239 bytes} [Thu May 27 03:53:40 2021] DELETE /compute/v2.1/servers/37adb209-bfbe-4ecf-9577-00c220c30b77 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 03:53:40.745065 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-866b2888-3dcd-4653-825d-d87a4f998206 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:53:40.747079 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-866b2888-3dcd-4653-825d-d87a4f998206 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] [instance: 37adb209-bfbe-4ecf-9577-00c220c30b77] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:53:40.753138 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-866b2888-3dcd-4653-825d-d87a4f998206 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:40.753581 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-866b2888-3dcd-4653-825d-d87a4f998206 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:40.754348 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-866b2888-3dcd-4653-825d-d87a4f998206 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:40.754779 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-866b2888-3dcd-4653-825d-d87a4f998206 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:40.953836 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-866b2888-3dcd-4653-825d-d87a4f998206 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ea32fdb1bc49aea23d70e94b58b9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f42048e6086405bb0d27fd16d9a85d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:53:40.961971 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-866b2888-3dcd-4653-825d-d87a4f998206 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] 10.222.0.25 "GET /compute/v2.1/servers/37adb209-bfbe-4ecf-9577-00c220c30b77" status: 200 len: 1502 microversion: 2.1 time: 0.221724 May 27 03:53:40.962539 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 746/1416] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:53:40 2021] GET /compute/v2.1/servers/37adb209-bfbe-4ecf-9577-00c220c30b77 => generated 1502 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:53:41.979611 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-890dbd59-7b8a-4ef9-bff3-e94bc8fa3e01 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:53:41.980310 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-890dbd59-7b8a-4ef9-bff3-e94bc8fa3e01 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] [instance: 37adb209-bfbe-4ecf-9577-00c220c30b77] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:53:41.987579 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-890dbd59-7b8a-4ef9-bff3-e94bc8fa3e01 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:41.988035 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-890dbd59-7b8a-4ef9-bff3-e94bc8fa3e01 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:41.988839 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-890dbd59-7b8a-4ef9-bff3-e94bc8fa3e01 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:41.989281 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-890dbd59-7b8a-4ef9-bff3-e94bc8fa3e01 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:42.195202 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-890dbd59-7b8a-4ef9-bff3-e94bc8fa3e01 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ea32fdb1bc49aea23d70e94b58b9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f42048e6086405bb0d27fd16d9a85d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:53:42.203318 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-890dbd59-7b8a-4ef9-bff3-e94bc8fa3e01 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] 10.222.0.25 "GET /compute/v2.1/servers/37adb209-bfbe-4ecf-9577-00c220c30b77" status: 200 len: 1502 microversion: 2.1 time: 0.227917 May 27 03:53:42.203881 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 671/1417] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:53:41 2021] GET /compute/v2.1/servers/37adb209-bfbe-4ecf-9577-00c220c30b77 => generated 1502 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:53:43.219684 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-8ae8e84c-d909-4965-a8ff-1112cc8f7a63 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:53:43.220298 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-8ae8e84c-d909-4965-a8ff-1112cc8f7a63 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] [instance: 37adb209-bfbe-4ecf-9577-00c220c30b77] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:53:43.228218 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8ae8e84c-d909-4965-a8ff-1112cc8f7a63 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:43.228690 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8ae8e84c-d909-4965-a8ff-1112cc8f7a63 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:43.229453 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8ae8e84c-d909-4965-a8ff-1112cc8f7a63 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:43.229889 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8ae8e84c-d909-4965-a8ff-1112cc8f7a63 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:43.420331 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-8ae8e84c-d909-4965-a8ff-1112cc8f7a63 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ea32fdb1bc49aea23d70e94b58b9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f42048e6086405bb0d27fd16d9a85d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:53:43.428386 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-8ae8e84c-d909-4965-a8ff-1112cc8f7a63 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] 10.222.0.25 "GET /compute/v2.1/servers/37adb209-bfbe-4ecf-9577-00c220c30b77" status: 200 len: 1502 microversion: 2.1 time: 0.212299 May 27 03:53:43.428969 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 747/1418] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:53:43 2021] GET /compute/v2.1/servers/37adb209-bfbe-4ecf-9577-00c220c30b77 => generated 1502 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:53:44.445094 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-8dbfe248-4281-47b5-bf78-0136f6ca89e7 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:53:44.445613 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-8dbfe248-4281-47b5-bf78-0136f6ca89e7 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] [instance: 37adb209-bfbe-4ecf-9577-00c220c30b77] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:53:44.453011 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8dbfe248-4281-47b5-bf78-0136f6ca89e7 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:44.453460 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8dbfe248-4281-47b5-bf78-0136f6ca89e7 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:44.454230 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8dbfe248-4281-47b5-bf78-0136f6ca89e7 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:44.454664 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8dbfe248-4281-47b5-bf78-0136f6ca89e7 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:44.646556 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-8dbfe248-4281-47b5-bf78-0136f6ca89e7 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ea32fdb1bc49aea23d70e94b58b9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f42048e6086405bb0d27fd16d9a85d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:53:44.656612 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-8dbfe248-4281-47b5-bf78-0136f6ca89e7 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] 10.222.0.25 "GET /compute/v2.1/servers/37adb209-bfbe-4ecf-9577-00c220c30b77" status: 200 len: 1502 microversion: 2.1 time: 0.215263 May 27 03:53:44.657180 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 672/1419] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:53:44 2021] GET /compute/v2.1/servers/37adb209-bfbe-4ecf-9577-00c220c30b77 => generated 1502 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:53:45.673948 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-ac2c52e7-09e3-4da9-aeac-b04623bf9b13 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:53:45.674563 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-ac2c52e7-09e3-4da9-aeac-b04623bf9b13 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] [instance: 37adb209-bfbe-4ecf-9577-00c220c30b77] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:53:45.682468 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ac2c52e7-09e3-4da9-aeac-b04623bf9b13 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:45.682919 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ac2c52e7-09e3-4da9-aeac-b04623bf9b13 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:45.683685 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ac2c52e7-09e3-4da9-aeac-b04623bf9b13 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:45.684123 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-ac2c52e7-09e3-4da9-aeac-b04623bf9b13 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:45.880060 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-ac2c52e7-09e3-4da9-aeac-b04623bf9b13 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ea32fdb1bc49aea23d70e94b58b9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f42048e6086405bb0d27fd16d9a85d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:53:45.888375 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-ac2c52e7-09e3-4da9-aeac-b04623bf9b13 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] 10.222.0.25 "GET /compute/v2.1/servers/37adb209-bfbe-4ecf-9577-00c220c30b77" status: 200 len: 1502 microversion: 2.1 time: 0.218118 May 27 03:53:45.888970 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 748/1420] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:53:45 2021] GET /compute/v2.1/servers/37adb209-bfbe-4ecf-9577-00c220c30b77 => generated 1502 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:53:46.905996 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-ca384051-8559-4532-a8f4-5ec73ed7d4f9 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:53:46.906616 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-ca384051-8559-4532-a8f4-5ec73ed7d4f9 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] [instance: 37adb209-bfbe-4ecf-9577-00c220c30b77] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:53:46.913885 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ca384051-8559-4532-a8f4-5ec73ed7d4f9 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:46.914324 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ca384051-8559-4532-a8f4-5ec73ed7d4f9 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:46.915102 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ca384051-8559-4532-a8f4-5ec73ed7d4f9 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:46.915542 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ca384051-8559-4532-a8f4-5ec73ed7d4f9 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:47.190263 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-ca384051-8559-4532-a8f4-5ec73ed7d4f9 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ea32fdb1bc49aea23d70e94b58b9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f42048e6086405bb0d27fd16d9a85d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:53:47.199378 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-ca384051-8559-4532-a8f4-5ec73ed7d4f9 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] 10.222.0.25 "GET /compute/v2.1/servers/37adb209-bfbe-4ecf-9577-00c220c30b77" status: 200 len: 1502 microversion: 2.1 time: 0.297209 May 27 03:53:47.199960 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 673/1421] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:53:46 2021] GET /compute/v2.1/servers/37adb209-bfbe-4ecf-9577-00c220c30b77 => generated 1502 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:53:47.402183 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [req-22fea1c5-0b94-4680-8284-0b33a5bda89e req-19d3952a-23e6-46fc-9429-50337b8e35d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37adb209-bfbe-4ecf-9577-00c220c30b77", "name": "network-vif-deleted", "tag": "7d0fd87d-55fb-4a67-b8d0-d04b8a281e11"}]} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:53:47.403692 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:53:47.403692 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: warnings.warn(msg) May 27 03:53:47.411769 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-22fea1c5-0b94-4680-8284-0b33a5bda89e req-19d3952a-23e6-46fc-9429-50337b8e35d8 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:47.412220 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-22fea1c5-0b94-4680-8284-0b33a5bda89e req-19d3952a-23e6-46fc-9429-50337b8e35d8 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:47.428283 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.compute.server_external_events [req-22fea1c5-0b94-4680-8284-0b33a5bda89e req-19d3952a-23e6-46fc-9429-50337b8e35d8 service nova] Creating event network-vif-deleted:7d0fd87d-55fb-4a67-b8d0-d04b8a281e11 for instance 37adb209-bfbe-4ecf-9577-00c220c30b77 on hv-cinder-79326 May 27 03:53:47.433070 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [req-22fea1c5-0b94-4680-8284-0b33a5bda89e req-19d3952a-23e6-46fc-9429-50337b8e35d8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034805 May 27 03:53:47.433639 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 749/1422] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:53:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:53:48.215662 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-980b8def-01e6-46c5-9caa-5ea97c564074 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:53:48.216281 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-980b8def-01e6-46c5-9caa-5ea97c564074 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] [instance: 37adb209-bfbe-4ecf-9577-00c220c30b77] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:53:48.223458 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-980b8def-01e6-46c5-9caa-5ea97c564074 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:48.223915 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-980b8def-01e6-46c5-9caa-5ea97c564074 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:48.224711 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-980b8def-01e6-46c5-9caa-5ea97c564074 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:48.225156 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-980b8def-01e6-46c5-9caa-5ea97c564074 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:48.294006 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-980b8def-01e6-46c5-9caa-5ea97c564074 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:48.294460 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-980b8def-01e6-46c5-9caa-5ea97c564074 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:48.294907 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.objects.instance [None req-980b8def-01e6-46c5-9caa-5ea97c564074 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lazy-loading 'fault' on Instance uuid 37adb209-bfbe-4ecf-9577-00c220c30b77 {{(pid=113021) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 27 03:53:48.606008 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-980b8def-01e6-46c5-9caa-5ea97c564074 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ea32fdb1bc49aea23d70e94b58b9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f42048e6086405bb0d27fd16d9a85d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:53:48.613359 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-980b8def-01e6-46c5-9caa-5ea97c564074 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] 10.222.0.25 "GET /compute/v2.1/servers/37adb209-bfbe-4ecf-9577-00c220c30b77" status: 200 len: 1303 microversion: 2.1 time: 0.401300 May 27 03:53:48.613918 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 674/1423] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:53:48 2021] GET /compute/v2.1/servers/37adb209-bfbe-4ecf-9577-00c220c30b77 => generated 1303 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:53:49.631951 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-911eca39-7beb-4cad-beca-639ed0dbc2e2 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:53:49.633268 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-911eca39-7beb-4cad-beca-639ed0dbc2e2 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] [instance: 37adb209-bfbe-4ecf-9577-00c220c30b77] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:53:49.640718 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-911eca39-7beb-4cad-beca-639ed0dbc2e2 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:49.641176 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-911eca39-7beb-4cad-beca-639ed0dbc2e2 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:49.641950 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-911eca39-7beb-4cad-beca-639ed0dbc2e2 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:49.642394 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-911eca39-7beb-4cad-beca-639ed0dbc2e2 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:49.691023 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.wsgi [None req-911eca39-7beb-4cad-beca-639ed0dbc2e2 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] HTTP exception thrown: Instance 37adb209-bfbe-4ecf-9577-00c220c30b77 could not be found. May 27 03:53:49.691625 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-911eca39-7beb-4cad-beca-639ed0dbc2e2 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Returning 404 to user: Instance 37adb209-bfbe-4ecf-9577-00c220c30b77 could not be found. {{(pid=113020) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 27 03:53:49.692498 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-911eca39-7beb-4cad-beca-639ed0dbc2e2 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] 10.222.0.25 "GET /compute/v2.1/servers/37adb209-bfbe-4ecf-9577-00c220c30b77" status: 404 len: 111 microversion: 2.1 time: 0.065282 May 27 03:53:49.693056 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 750/1424] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:53:49 2021] GET /compute/v2.1/servers/37adb209-bfbe-4ecf-9577-00c220c30b77 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:53:49.827674 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-c8854730-6aae-4a65-90fa-09d7621568ac tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-75585783", "imageRef": "78c0913d-0e41-4b41-b38f-f45c4f2535ff", "flavorRef": "452", "networks": [{"uuid": "46de24cd-29cd-4b19-97dd-c1e473696501"}]}} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:53:49.891865 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.network.neutron [None req-c8854730-6aae-4a65-90fa-09d7621568ac tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] validate_networks() for [('46de24cd-29cd-4b19-97dd-c1e473696501', None, None, None)] {{(pid=113021) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 27 03:53:50.367234 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.virt.hardware [None req-c8854730-6aae-4a65-90fa-09d7621568ac tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Flavor limits 0:0:0 {{(pid=113021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 27 03:53:50.367663 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.virt.hardware [None req-c8854730-6aae-4a65-90fa-09d7621568ac tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Image limits 0:0:0 {{(pid=113021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 27 03:53:50.368151 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.virt.hardware [None req-c8854730-6aae-4a65-90fa-09d7621568ac tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Flavor pref 0:0:0 {{(pid=113021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 27 03:53:50.368625 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.virt.hardware [None req-c8854730-6aae-4a65-90fa-09d7621568ac tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Image pref 0:0:0 {{(pid=113021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 27 03:53:50.369042 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.virt.hardware [None req-c8854730-6aae-4a65-90fa-09d7621568ac tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=113021) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 27 03:53:50.377389 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c8854730-6aae-4a65-90fa-09d7621568ac tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:50.378177 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c8854730-6aae-4a65-90fa-09d7621568ac tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:50.378986 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c8854730-6aae-4a65-90fa-09d7621568ac tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:50.379421 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c8854730-6aae-4a65-90fa-09d7621568ac tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:50.396244 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.quota [None req-c8854730-6aae-4a65-90fa-09d7621568ac tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Getting quotas for project 3f42048e6086405bb0d27fd16d9a85d2. Resources: {'instances', 'cores', 'ram'} {{(pid=113021) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 27 03:53:50.400736 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.quota [None req-c8854730-6aae-4a65-90fa-09d7621568ac tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Getting quotas for user 63ea32fdb1bc49aea23d70e94b58b9e1 and project 3f42048e6086405bb0d27fd16d9a85d2. Resources: {'instances', 'cores', 'ram'} {{(pid=113021) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 27 03:53:50.411586 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-c8854730-6aae-4a65-90fa-09d7621568ac tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Going to run 1 instances... {{(pid=113021) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 27 03:53:50.414549 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-c8854730-6aae-4a65-90fa-09d7621568ac tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] [instance: ad8ba7e5-112e-4f9a-8832-8db81d35313c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78c0913d-0e41-4b41-b38f-f45c4f2535ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=113021) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 27 03:53:50.603731 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-c8854730-6aae-4a65-90fa-09d7621568ac tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.779651 May 27 03:53:50.604379 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 675/1425] 10.222.0.25 () {60 vars in 1147 bytes} [Thu May 27 03:53:49 2021] POST /compute/v2.1/servers => generated 380 bytes in 781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 03:53:50.614176 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-12e3ca38-2b02-4790-85b2-62cce909bd9c tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:53:50.614796 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-12e3ca38-2b02-4790-85b2-62cce909bd9c tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] [instance: ad8ba7e5-112e-4f9a-8832-8db81d35313c] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:53:50.692832 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-12e3ca38-2b02-4790-85b2-62cce909bd9c tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ea32fdb1bc49aea23d70e94b58b9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f42048e6086405bb0d27fd16d9a85d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:53:50.700984 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-12e3ca38-2b02-4790-85b2-62cce909bd9c tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] 10.222.0.25 "GET /compute/v2.1/servers/ad8ba7e5-112e-4f9a-8832-8db81d35313c" status: 200 len: 1212 microversion: 2.1 time: 0.090270 May 27 03:53:50.722089 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 751/1426] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:53:50 2021] GET /compute/v2.1/servers/ad8ba7e5-112e-4f9a-8832-8db81d35313c => generated 1212 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:53:51.739444 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-6c55c06d-5ebd-471f-b009-9ccd8fec23f8 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:53:51.740057 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-6c55c06d-5ebd-471f-b009-9ccd8fec23f8 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] [instance: ad8ba7e5-112e-4f9a-8832-8db81d35313c] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:53:51.747878 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6c55c06d-5ebd-471f-b009-9ccd8fec23f8 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:51.748332 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6c55c06d-5ebd-471f-b009-9ccd8fec23f8 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:51.749125 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6c55c06d-5ebd-471f-b009-9ccd8fec23f8 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:51.749559 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-6c55c06d-5ebd-471f-b009-9ccd8fec23f8 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:51.864586 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-6c55c06d-5ebd-471f-b009-9ccd8fec23f8 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ea32fdb1bc49aea23d70e94b58b9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f42048e6086405bb0d27fd16d9a85d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:53:51.873518 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-6c55c06d-5ebd-471f-b009-9ccd8fec23f8 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] 10.222.0.25 "GET /compute/v2.1/servers/ad8ba7e5-112e-4f9a-8832-8db81d35313c" status: 200 len: 1208 microversion: 2.1 time: 0.137772 May 27 03:53:51.874111 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 676/1427] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:53:51 2021] GET /compute/v2.1/servers/ad8ba7e5-112e-4f9a-8832-8db81d35313c => generated 1208 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:53:52.888242 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: ERROR oslo.messaging._drivers.impl_rabbit [-] [76781c65-3633-4e79-8ccf-55fa2808f360] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 27 03:53:52.891508 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-075d9395-b6b7-4dc1-b3f7-c5990e8e5ab0 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:53:52.892123 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-075d9395-b6b7-4dc1-b3f7-c5990e8e5ab0 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] [instance: ad8ba7e5-112e-4f9a-8832-8db81d35313c] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:53:52.899971 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-075d9395-b6b7-4dc1-b3f7-c5990e8e5ab0 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:52.900446 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-075d9395-b6b7-4dc1-b3f7-c5990e8e5ab0 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:52.901469 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-075d9395-b6b7-4dc1-b3f7-c5990e8e5ab0 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:52.901906 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-075d9395-b6b7-4dc1-b3f7-c5990e8e5ab0 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:53.013617 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-075d9395-b6b7-4dc1-b3f7-c5990e8e5ab0 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ea32fdb1bc49aea23d70e94b58b9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f42048e6086405bb0d27fd16d9a85d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:53:53.021592 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-075d9395-b6b7-4dc1-b3f7-c5990e8e5ab0 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] 10.222.0.25 "GET /compute/v2.1/servers/ad8ba7e5-112e-4f9a-8832-8db81d35313c" status: 200 len: 1208 microversion: 2.1 time: 0.134810 May 27 03:53:53.022139 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 752/1428] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:53:52 2021] GET /compute/v2.1/servers/ad8ba7e5-112e-4f9a-8832-8db81d35313c => generated 1208 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:53:54.038426 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-3ecea19d-c735-49f1-b033-ec6d417c746c tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:53:54.039080 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-3ecea19d-c735-49f1-b033-ec6d417c746c tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] [instance: ad8ba7e5-112e-4f9a-8832-8db81d35313c] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:53:54.046326 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-3ecea19d-c735-49f1-b033-ec6d417c746c tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:54.046781 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-3ecea19d-c735-49f1-b033-ec6d417c746c tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:54.047552 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-3ecea19d-c735-49f1-b033-ec6d417c746c tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:54.047991 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-3ecea19d-c735-49f1-b033-ec6d417c746c tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:54.158526 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-3ecea19d-c735-49f1-b033-ec6d417c746c tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ea32fdb1bc49aea23d70e94b58b9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f42048e6086405bb0d27fd16d9a85d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:53:54.166489 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-3ecea19d-c735-49f1-b033-ec6d417c746c tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] 10.222.0.25 "GET /compute/v2.1/servers/ad8ba7e5-112e-4f9a-8832-8db81d35313c" status: 200 len: 1208 microversion: 2.1 time: 0.131834 May 27 03:53:54.167050 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 677/1429] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:53:54 2021] GET /compute/v2.1/servers/ad8ba7e5-112e-4f9a-8832-8db81d35313c => generated 1208 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:53:55.182674 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-a4e36c70-1448-4387-9406-3e8e99501b5c tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:53:55.183231 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-a4e36c70-1448-4387-9406-3e8e99501b5c tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] [instance: ad8ba7e5-112e-4f9a-8832-8db81d35313c] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:53:55.201495 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a4e36c70-1448-4387-9406-3e8e99501b5c tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:55.201953 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a4e36c70-1448-4387-9406-3e8e99501b5c tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:55.202736 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a4e36c70-1448-4387-9406-3e8e99501b5c tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:55.203175 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a4e36c70-1448-4387-9406-3e8e99501b5c tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:55.259350 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO oslo.messaging._drivers.impl_rabbit [-] [76781c65-3633-4e79-8ccf-55fa2808f360] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 43074. May 27 03:53:55.321643 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-a4e36c70-1448-4387-9406-3e8e99501b5c tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ea32fdb1bc49aea23d70e94b58b9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f42048e6086405bb0d27fd16d9a85d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:53:55.329631 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-a4e36c70-1448-4387-9406-3e8e99501b5c tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] 10.222.0.25 "GET /compute/v2.1/servers/ad8ba7e5-112e-4f9a-8832-8db81d35313c" status: 200 len: 1264 microversion: 2.1 time: 0.150805 May 27 03:53:55.330176 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 753/1430] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:53:55 2021] GET /compute/v2.1/servers/ad8ba7e5-112e-4f9a-8832-8db81d35313c => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:53:56.346662 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-02faeeb9-bb51-43d7-82be-f1ef32a6555d tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:53:56.347309 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-02faeeb9-bb51-43d7-82be-f1ef32a6555d tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] [instance: ad8ba7e5-112e-4f9a-8832-8db81d35313c] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:53:56.357467 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-02faeeb9-bb51-43d7-82be-f1ef32a6555d tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:56.357935 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-02faeeb9-bb51-43d7-82be-f1ef32a6555d tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:56.358868 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-02faeeb9-bb51-43d7-82be-f1ef32a6555d tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:56.359319 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-02faeeb9-bb51-43d7-82be-f1ef32a6555d tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:56.517607 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-02faeeb9-bb51-43d7-82be-f1ef32a6555d tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ea32fdb1bc49aea23d70e94b58b9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f42048e6086405bb0d27fd16d9a85d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:53:56.527849 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-02faeeb9-bb51-43d7-82be-f1ef32a6555d tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] 10.222.0.25 "GET /compute/v2.1/servers/ad8ba7e5-112e-4f9a-8832-8db81d35313c" status: 200 len: 1270 microversion: 2.1 time: 0.184824 May 27 03:53:56.528441 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 678/1431] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:53:56 2021] GET /compute/v2.1/servers/ad8ba7e5-112e-4f9a-8832-8db81d35313c => generated 1270 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:53:57.545335 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-b1ac745d-8a16-4916-b67c-1cf748208345 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:53:57.545942 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-b1ac745d-8a16-4916-b67c-1cf748208345 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] [instance: ad8ba7e5-112e-4f9a-8832-8db81d35313c] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:53:57.553990 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b1ac745d-8a16-4916-b67c-1cf748208345 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:57.554468 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b1ac745d-8a16-4916-b67c-1cf748208345 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:57.555246 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b1ac745d-8a16-4916-b67c-1cf748208345 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:57.555719 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b1ac745d-8a16-4916-b67c-1cf748208345 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:57.751896 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-b1ac745d-8a16-4916-b67c-1cf748208345 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ea32fdb1bc49aea23d70e94b58b9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f42048e6086405bb0d27fd16d9a85d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:53:57.760259 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-b1ac745d-8a16-4916-b67c-1cf748208345 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] 10.222.0.25 "GET /compute/v2.1/servers/ad8ba7e5-112e-4f9a-8832-8db81d35313c" status: 200 len: 1312 microversion: 2.1 time: 0.218532 May 27 03:53:57.761093 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 754/1432] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:53:57 2021] GET /compute/v2.1/servers/ad8ba7e5-112e-4f9a-8832-8db81d35313c => generated 1312 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:53:58.105646 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [req-f5695f3d-feb6-464a-b26d-fce106f1290e req-6a7662e5-eb1d-4f1f-9aff-ce7e38e0f4c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad8ba7e5-112e-4f9a-8832-8db81d35313c", "tag": "b9acf257-b47b-4768-8ada-7609bc50d84e"}]} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:53:58.107295 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:53:58.107295 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: warnings.warn(msg) May 27 03:53:58.116665 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-f5695f3d-feb6-464a-b26d-fce106f1290e req-6a7662e5-eb1d-4f1f-9aff-ce7e38e0f4c3 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:58.117157 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-f5695f3d-feb6-464a-b26d-fce106f1290e req-6a7662e5-eb1d-4f1f-9aff-ce7e38e0f4c3 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:58.139026 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.compute.server_external_events [req-f5695f3d-feb6-464a-b26d-fce106f1290e req-6a7662e5-eb1d-4f1f-9aff-ce7e38e0f4c3 service nova] Creating event network-changed:b9acf257-b47b-4768-8ada-7609bc50d84e for instance ad8ba7e5-112e-4f9a-8832-8db81d35313c on hv-cinder-79326 May 27 03:53:58.153147 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [req-f5695f3d-feb6-464a-b26d-fce106f1290e req-6a7662e5-eb1d-4f1f-9aff-ce7e38e0f4c3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042765 May 27 03:53:58.153147 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 679/1433] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:53:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:53:58.778838 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-d328fe61-9863-4282-ae64-b4cd7fa15d97 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:53:58.778838 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-d328fe61-9863-4282-ae64-b4cd7fa15d97 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] [instance: ad8ba7e5-112e-4f9a-8832-8db81d35313c] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:53:58.784122 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d328fe61-9863-4282-ae64-b4cd7fa15d97 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:58.784613 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d328fe61-9863-4282-ae64-b4cd7fa15d97 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:58.785392 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d328fe61-9863-4282-ae64-b4cd7fa15d97 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:53:58.785831 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-d328fe61-9863-4282-ae64-b4cd7fa15d97 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:53:58.984265 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-d328fe61-9863-4282-ae64-b4cd7fa15d97 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ea32fdb1bc49aea23d70e94b58b9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f42048e6086405bb0d27fd16d9a85d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:53:58.993258 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-d328fe61-9863-4282-ae64-b4cd7fa15d97 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] 10.222.0.25 "GET /compute/v2.1/servers/ad8ba7e5-112e-4f9a-8832-8db81d35313c" status: 200 len: 1312 microversion: 2.1 time: 0.220675 May 27 03:53:58.994154 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 755/1434] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:53:58 2021] GET /compute/v2.1/servers/ad8ba7e5-112e-4f9a-8832-8db81d35313c => generated 1312 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:54:00.010299 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-e76ba77d-8127-4e73-a01e-4b2d44452bd6 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:54:00.011005 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-e76ba77d-8127-4e73-a01e-4b2d44452bd6 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] [instance: ad8ba7e5-112e-4f9a-8832-8db81d35313c] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:54:00.018567 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e76ba77d-8127-4e73-a01e-4b2d44452bd6 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:54:00.019003 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e76ba77d-8127-4e73-a01e-4b2d44452bd6 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:54:00.019782 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e76ba77d-8127-4e73-a01e-4b2d44452bd6 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:54:00.020224 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e76ba77d-8127-4e73-a01e-4b2d44452bd6 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:54:00.345287 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-e76ba77d-8127-4e73-a01e-4b2d44452bd6 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ea32fdb1bc49aea23d70e94b58b9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f42048e6086405bb0d27fd16d9a85d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:54:00.353415 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-e76ba77d-8127-4e73-a01e-4b2d44452bd6 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] 10.222.0.25 "GET /compute/v2.1/servers/ad8ba7e5-112e-4f9a-8832-8db81d35313c" status: 200 len: 1312 microversion: 2.1 time: 0.347743 May 27 03:54:00.353981 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 680/1435] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:54:00 2021] GET /compute/v2.1/servers/ad8ba7e5-112e-4f9a-8832-8db81d35313c => generated 1312 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:54:01.370099 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-c4146d11-8d33-4b2f-b931-b4b0e18fa426 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:54:01.370721 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-c4146d11-8d33-4b2f-b931-b4b0e18fa426 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] [instance: ad8ba7e5-112e-4f9a-8832-8db81d35313c] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:54:01.378423 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c4146d11-8d33-4b2f-b931-b4b0e18fa426 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:54:01.378882 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c4146d11-8d33-4b2f-b931-b4b0e18fa426 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:54:01.379668 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c4146d11-8d33-4b2f-b931-b4b0e18fa426 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:54:01.380110 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c4146d11-8d33-4b2f-b931-b4b0e18fa426 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:54:01.582305 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-c4146d11-8d33-4b2f-b931-b4b0e18fa426 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ea32fdb1bc49aea23d70e94b58b9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f42048e6086405bb0d27fd16d9a85d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:54:01.591218 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-c4146d11-8d33-4b2f-b931-b4b0e18fa426 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] 10.222.0.25 "GET /compute/v2.1/servers/ad8ba7e5-112e-4f9a-8832-8db81d35313c" status: 200 len: 1312 microversion: 2.1 time: 0.224793 May 27 03:54:01.591782 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 756/1436] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:54:01 2021] GET /compute/v2.1/servers/ad8ba7e5-112e-4f9a-8832-8db81d35313c => generated 1312 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:54:02.605904 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: ERROR oslo.messaging._drivers.impl_rabbit [-] [20689b0c-35f1-46a0-8459-afcb436c4aac] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 27 03:54:02.609301 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-29b1cf7f-aea4-4a9e-8ae5-125563be2b68 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:54:02.609968 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-29b1cf7f-aea4-4a9e-8ae5-125563be2b68 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] [instance: ad8ba7e5-112e-4f9a-8832-8db81d35313c] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:54:02.617601 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-29b1cf7f-aea4-4a9e-8ae5-125563be2b68 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:54:02.618056 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-29b1cf7f-aea4-4a9e-8ae5-125563be2b68 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:54:02.618817 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-29b1cf7f-aea4-4a9e-8ae5-125563be2b68 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:54:02.619258 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-29b1cf7f-aea4-4a9e-8ae5-125563be2b68 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:54:02.830537 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-29b1cf7f-aea4-4a9e-8ae5-125563be2b68 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ea32fdb1bc49aea23d70e94b58b9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f42048e6086405bb0d27fd16d9a85d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:54:02.837259 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-29b1cf7f-aea4-4a9e-8ae5-125563be2b68 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] 10.222.0.25 "GET /compute/v2.1/servers/ad8ba7e5-112e-4f9a-8832-8db81d35313c" status: 200 len: 1312 microversion: 2.1 time: 0.232753 May 27 03:54:02.837837 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 681/1437] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:54:02 2021] GET /compute/v2.1/servers/ad8ba7e5-112e-4f9a-8832-8db81d35313c => generated 1312 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:54:03.856477 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-bbeaccea-fa8b-43cc-a412-77d4fd330ba2 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:54:03.857103 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-bbeaccea-fa8b-43cc-a412-77d4fd330ba2 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] [instance: ad8ba7e5-112e-4f9a-8832-8db81d35313c] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:54:03.864319 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-bbeaccea-fa8b-43cc-a412-77d4fd330ba2 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:54:03.865509 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-bbeaccea-fa8b-43cc-a412-77d4fd330ba2 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:54:03.866174 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-bbeaccea-fa8b-43cc-a412-77d4fd330ba2 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:54:03.866610 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-bbeaccea-fa8b-43cc-a412-77d4fd330ba2 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:54:04.063100 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-bbeaccea-fa8b-43cc-a412-77d4fd330ba2 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ea32fdb1bc49aea23d70e94b58b9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f42048e6086405bb0d27fd16d9a85d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:54:04.071262 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-bbeaccea-fa8b-43cc-a412-77d4fd330ba2 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] 10.222.0.25 "GET /compute/v2.1/servers/ad8ba7e5-112e-4f9a-8832-8db81d35313c" status: 200 len: 1312 microversion: 2.1 time: 0.220611 May 27 03:54:04.071826 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 757/1438] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:54:03 2021] GET /compute/v2.1/servers/ad8ba7e5-112e-4f9a-8832-8db81d35313c => generated 1312 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:54:04.485046 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [req-4bdf06a8-6637-4c69-a189-38809ced1d23 req-56fac01a-c185-45f6-acf2-9959cbd9d1e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad8ba7e5-112e-4f9a-8832-8db81d35313c", "name": "network-vif-plugged", "status": "completed", "tag": "b9acf257-b47b-4768-8ada-7609bc50d84e"}]} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:54:04.486586 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:54:04.486586 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: warnings.warn(msg) May 27 03:54:04.507956 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-4bdf06a8-6637-4c69-a189-38809ced1d23 req-56fac01a-c185-45f6-acf2-9959cbd9d1e0 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:54:04.508421 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-4bdf06a8-6637-4c69-a189-38809ced1d23 req-56fac01a-c185-45f6-acf2-9959cbd9d1e0 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:54:04.525522 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.compute.server_external_events [req-4bdf06a8-6637-4c69-a189-38809ced1d23 req-56fac01a-c185-45f6-acf2-9959cbd9d1e0 service nova] Creating event network-vif-plugged:b9acf257-b47b-4768-8ada-7609bc50d84e for instance ad8ba7e5-112e-4f9a-8832-8db81d35313c on hv-cinder-79326 May 27 03:54:04.528967 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO oslo.messaging._drivers.impl_rabbit [-] [20689b0c-35f1-46a0-8459-afcb436c4aac] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 43180. May 27 03:54:04.530453 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [req-4bdf06a8-6637-4c69-a189-38809ced1d23 req-56fac01a-c185-45f6-acf2-9959cbd9d1e0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049194 May 27 03:54:04.531036 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 682/1439] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:54:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:54:05.088013 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-2622feef-ae17-4ff9-931d-3396d55c3d45 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:54:05.088565 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-2622feef-ae17-4ff9-931d-3396d55c3d45 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] [instance: ad8ba7e5-112e-4f9a-8832-8db81d35313c] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:54:05.095797 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-2622feef-ae17-4ff9-931d-3396d55c3d45 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:54:05.096248 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-2622feef-ae17-4ff9-931d-3396d55c3d45 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:54:05.097054 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-2622feef-ae17-4ff9-931d-3396d55c3d45 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:54:05.097493 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-2622feef-ae17-4ff9-931d-3396d55c3d45 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:54:05.289249 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-2622feef-ae17-4ff9-931d-3396d55c3d45 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ea32fdb1bc49aea23d70e94b58b9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f42048e6086405bb0d27fd16d9a85d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:54:05.297281 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-2622feef-ae17-4ff9-931d-3396d55c3d45 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] 10.222.0.25 "GET /compute/v2.1/servers/ad8ba7e5-112e-4f9a-8832-8db81d35313c" status: 200 len: 1312 microversion: 2.1 time: 0.213012 May 27 03:54:05.297848 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 758/1440] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:54:05 2021] GET /compute/v2.1/servers/ad8ba7e5-112e-4f9a-8832-8db81d35313c => generated 1312 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:54:06.315696 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-d4caab8e-d2d1-47ec-bd6d-565cd982ec72 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:54:06.316418 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-d4caab8e-d2d1-47ec-bd6d-565cd982ec72 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] [instance: ad8ba7e5-112e-4f9a-8832-8db81d35313c] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:54:06.324835 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d4caab8e-d2d1-47ec-bd6d-565cd982ec72 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:54:06.325283 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d4caab8e-d2d1-47ec-bd6d-565cd982ec72 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:54:06.326085 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d4caab8e-d2d1-47ec-bd6d-565cd982ec72 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:54:06.326545 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-d4caab8e-d2d1-47ec-bd6d-565cd982ec72 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:54:06.528694 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-d4caab8e-d2d1-47ec-bd6d-565cd982ec72 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ea32fdb1bc49aea23d70e94b58b9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f42048e6086405bb0d27fd16d9a85d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:54:06.536920 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-d4caab8e-d2d1-47ec-bd6d-565cd982ec72 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] 10.222.0.25 "GET /compute/v2.1/servers/ad8ba7e5-112e-4f9a-8832-8db81d35313c" status: 200 len: 1495 microversion: 2.1 time: 0.225948 May 27 03:54:06.539370 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 683/1441] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:54:06 2021] GET /compute/v2.1/servers/ad8ba7e5-112e-4f9a-8832-8db81d35313c => generated 1495 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:54:07.675028 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-93ee7f11-9668-49b6-a874-e7e448996648 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:54:07.675536 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-93ee7f11-9668-49b6-a874-e7e448996648 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] [instance: ad8ba7e5-112e-4f9a-8832-8db81d35313c] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:54:07.683341 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-93ee7f11-9668-49b6-a874-e7e448996648 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:54:07.683796 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-93ee7f11-9668-49b6-a874-e7e448996648 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:54:07.684602 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-93ee7f11-9668-49b6-a874-e7e448996648 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:54:07.685041 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-93ee7f11-9668-49b6-a874-e7e448996648 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:54:07.838885 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-93ee7f11-9668-49b6-a874-e7e448996648 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] [instance: ad8ba7e5-112e-4f9a-8832-8db81d35313c] Going to try to terminate instance {{(pid=113020) delete /opt/stack/nova/nova/compute/api.py:2539}} May 27 03:54:08.065442 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-93ee7f11-9668-49b6-a874-e7e448996648 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ad8ba7e5-112e-4f9a-8832-8db81d35313c" status: 204 len: 0 microversion: 2.1 time: 0.393732 May 27 03:54:08.066042 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 759/1442] 10.222.0.25 () {58 vars in 1239 bytes} [Thu May 27 03:54:07 2021] DELETE /compute/v2.1/servers/ad8ba7e5-112e-4f9a-8832-8db81d35313c => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 03:54:08.074000 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-0a37af70-e153-4600-b2ff-14f6f3c54e26 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:54:08.074875 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-0a37af70-e153-4600-b2ff-14f6f3c54e26 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] [instance: ad8ba7e5-112e-4f9a-8832-8db81d35313c] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:54:08.081824 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-0a37af70-e153-4600-b2ff-14f6f3c54e26 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:54:08.082282 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-0a37af70-e153-4600-b2ff-14f6f3c54e26 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:54:08.083052 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-0a37af70-e153-4600-b2ff-14f6f3c54e26 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:54:08.083640 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-0a37af70-e153-4600-b2ff-14f6f3c54e26 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:54:08.277249 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-0a37af70-e153-4600-b2ff-14f6f3c54e26 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ea32fdb1bc49aea23d70e94b58b9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f42048e6086405bb0d27fd16d9a85d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:54:08.285430 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-0a37af70-e153-4600-b2ff-14f6f3c54e26 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] 10.222.0.25 "GET /compute/v2.1/servers/ad8ba7e5-112e-4f9a-8832-8db81d35313c" status: 200 len: 1501 microversion: 2.1 time: 0.215124 May 27 03:54:08.286773 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 684/1443] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:54:08 2021] GET /compute/v2.1/servers/ad8ba7e5-112e-4f9a-8832-8db81d35313c => generated 1501 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:54:09.305451 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-3fd44d09-8dd2-4d18-ba58-eeedbf53b613 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:54:09.305895 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-3fd44d09-8dd2-4d18-ba58-eeedbf53b613 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] [instance: ad8ba7e5-112e-4f9a-8832-8db81d35313c] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:54:09.313492 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3fd44d09-8dd2-4d18-ba58-eeedbf53b613 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:54:09.313995 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3fd44d09-8dd2-4d18-ba58-eeedbf53b613 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:54:09.314782 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3fd44d09-8dd2-4d18-ba58-eeedbf53b613 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:54:09.315216 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3fd44d09-8dd2-4d18-ba58-eeedbf53b613 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:54:09.529140 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-3fd44d09-8dd2-4d18-ba58-eeedbf53b613 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ea32fdb1bc49aea23d70e94b58b9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f42048e6086405bb0d27fd16d9a85d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:54:09.540977 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-3fd44d09-8dd2-4d18-ba58-eeedbf53b613 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] 10.222.0.25 "GET /compute/v2.1/servers/ad8ba7e5-112e-4f9a-8832-8db81d35313c" status: 200 len: 1501 microversion: 2.1 time: 0.241301 May 27 03:54:09.542799 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 760/1444] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:54:09 2021] GET /compute/v2.1/servers/ad8ba7e5-112e-4f9a-8832-8db81d35313c => generated 1501 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:54:10.329931 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [req-e4511df8-779c-468b-ba10-797f82d1f046 req-1ecb4e4b-22a8-4b01-b642-17251628cc88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad8ba7e5-112e-4f9a-8832-8db81d35313c", "name": "network-vif-deleted", "tag": "b9acf257-b47b-4768-8ada-7609bc50d84e"}]} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:54:10.332962 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:54:10.332962 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: warnings.warn(msg) May 27 03:54:10.342937 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-e4511df8-779c-468b-ba10-797f82d1f046 req-1ecb4e4b-22a8-4b01-b642-17251628cc88 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:54:10.343434 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-e4511df8-779c-468b-ba10-797f82d1f046 req-1ecb4e4b-22a8-4b01-b642-17251628cc88 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:54:10.359118 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.compute.server_external_events [req-e4511df8-779c-468b-ba10-797f82d1f046 req-1ecb4e4b-22a8-4b01-b642-17251628cc88 service nova] Creating event network-vif-deleted:b9acf257-b47b-4768-8ada-7609bc50d84e for instance ad8ba7e5-112e-4f9a-8832-8db81d35313c on hv-cinder-79326 May 27 03:54:10.364039 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [req-e4511df8-779c-468b-ba10-797f82d1f046 req-1ecb4e4b-22a8-4b01-b642-17251628cc88 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041559 May 27 03:54:10.364721 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 685/1445] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:54:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:54:10.558394 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-12037d52-ba2d-449f-89ae-77e21230edc8 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:54:10.559007 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-12037d52-ba2d-449f-89ae-77e21230edc8 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] [instance: ad8ba7e5-112e-4f9a-8832-8db81d35313c] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:54:10.566663 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-12037d52-ba2d-449f-89ae-77e21230edc8 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:54:10.567140 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-12037d52-ba2d-449f-89ae-77e21230edc8 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:54:10.568624 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-12037d52-ba2d-449f-89ae-77e21230edc8 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:54:10.569217 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-12037d52-ba2d-449f-89ae-77e21230edc8 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:54:10.688476 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-12037d52-ba2d-449f-89ae-77e21230edc8 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ea32fdb1bc49aea23d70e94b58b9e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f42048e6086405bb0d27fd16d9a85d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:54:10.697136 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-12037d52-ba2d-449f-89ae-77e21230edc8 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] 10.222.0.25 "GET /compute/v2.1/servers/ad8ba7e5-112e-4f9a-8832-8db81d35313c" status: 200 len: 1297 microversion: 2.1 time: 0.142798 May 27 03:54:10.697698 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 761/1446] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:54:10 2021] GET /compute/v2.1/servers/ad8ba7e5-112e-4f9a-8832-8db81d35313c => generated 1297 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:54:11.714834 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-1d25597c-895b-4ff1-8fe7-b85b21284136 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:54:11.715543 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-1d25597c-895b-4ff1-8fe7-b85b21284136 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] [instance: ad8ba7e5-112e-4f9a-8832-8db81d35313c] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:54:11.722977 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1d25597c-895b-4ff1-8fe7-b85b21284136 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:54:11.723433 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1d25597c-895b-4ff1-8fe7-b85b21284136 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:54:11.724800 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1d25597c-895b-4ff1-8fe7-b85b21284136 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:54:11.725239 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-1d25597c-895b-4ff1-8fe7-b85b21284136 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:54:11.776701 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.wsgi [None req-1d25597c-895b-4ff1-8fe7-b85b21284136 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] HTTP exception thrown: Instance ad8ba7e5-112e-4f9a-8832-8db81d35313c could not be found. May 27 03:54:11.777305 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-1d25597c-895b-4ff1-8fe7-b85b21284136 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] Returning 404 to user: Instance ad8ba7e5-112e-4f9a-8832-8db81d35313c could not be found. {{(pid=113021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 27 03:54:11.778140 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-1d25597c-895b-4ff1-8fe7-b85b21284136 tempest-VolumesActionsTest-1215670824 tempest-VolumesActionsTest-1215670824-project] 10.222.0.25 "GET /compute/v2.1/servers/ad8ba7e5-112e-4f9a-8832-8db81d35313c" status: 404 len: 111 microversion: 2.1 time: 0.067467 May 27 03:54:11.778686 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 686/1447] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:54:11 2021] GET /compute/v2.1/servers/ad8ba7e5-112e-4f9a-8832-8db81d35313c => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:55:54.249097 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 03:55:54.249814 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: Thu May 27 03:55:54 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 03:56:03.108101 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-6eac1ecc-409b-4e7d-90e9-661e2ce7fd1e tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-201635547", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-482559929", "security_groups": [{"name": "tempest-secgroup-smoke-1920270131"}], "block_device_mapping_v2": [{"uuid": "4544b557-2988-4895-8f8f-da6759cb4917", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e3d5c143-f0ba-4a03-b1d4-d1be1e83dd0f"}]}} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:56:03.261415 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.network.neutron [None req-6eac1ecc-409b-4e7d-90e9-661e2ce7fd1e tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] validate_networks() for [('e3d5c143-f0ba-4a03-b1d4-d1be1e83dd0f', None, None, None)] {{(pid=113020) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 27 03:56:03.997105 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.virt.hardware [None req-6eac1ecc-409b-4e7d-90e9-661e2ce7fd1e tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Flavor limits 0:0:0 {{(pid=113020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 27 03:56:03.997538 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.virt.hardware [None req-6eac1ecc-409b-4e7d-90e9-661e2ce7fd1e tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Image limits 0:0:0 {{(pid=113020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 27 03:56:03.998022 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.virt.hardware [None req-6eac1ecc-409b-4e7d-90e9-661e2ce7fd1e tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Flavor pref 0:0:0 {{(pid=113020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 27 03:56:03.998519 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.virt.hardware [None req-6eac1ecc-409b-4e7d-90e9-661e2ce7fd1e tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Image pref 0:0:0 {{(pid=113020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 27 03:56:03.998947 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.virt.hardware [None req-6eac1ecc-409b-4e7d-90e9-661e2ce7fd1e tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=113020) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 27 03:56:04.007291 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6eac1ecc-409b-4e7d-90e9-661e2ce7fd1e tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:56:04.007743 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6eac1ecc-409b-4e7d-90e9-661e2ce7fd1e tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:56:04.008625 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6eac1ecc-409b-4e7d-90e9-661e2ce7fd1e tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:56:04.009070 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-6eac1ecc-409b-4e7d-90e9-661e2ce7fd1e tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:56:04.026670 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.quota [None req-6eac1ecc-409b-4e7d-90e9-661e2ce7fd1e tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Getting quotas for project 6b6a582a2a304a7d881efcfa2373dfb1. Resources: {'instances', 'cores', 'ram'} {{(pid=113020) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 27 03:56:04.030616 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.quota [None req-6eac1ecc-409b-4e7d-90e9-661e2ce7fd1e tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Getting quotas for user 4fba01f5f17648a7a1fd0fbefd56e046 and project 6b6a582a2a304a7d881efcfa2373dfb1. Resources: {'instances', 'cores', 'ram'} {{(pid=113020) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 27 03:56:04.127222 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-6eac1ecc-409b-4e7d-90e9-661e2ce7fd1e tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Going to run 1 instances... {{(pid=113020) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 27 03:56:04.129373 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-6eac1ecc-409b-4e7d-90e9-661e2ce7fd1e tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: ea6a4f71-9eac-42b4-bba2-a81456c3d2a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4544b557-2988-4895-8f8f-da6759cb4917',volume_size=None,volume_type=None)] {{(pid=113020) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 27 03:56:04.473404 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6eac1ecc-409b-4e7d-90e9-661e2ce7fd1e tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [60c5d240-bb10-41c8-a1ec-add0a8cfc48b] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 27 03:56:05.491195 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO oslo.messaging._drivers.impl_rabbit [None req-6eac1ecc-409b-4e7d-90e9-661e2ce7fd1e tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [60c5d240-bb10-41c8-a1ec-add0a8cfc48b] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 44258. May 27 03:56:05.494926 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-6eac1ecc-409b-4e7d-90e9-661e2ce7fd1e tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.390721 May 27 03:56:05.495695 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 762/1448] 10.222.0.25 () {60 vars in 1147 bytes} [Thu May 27 03:56:03 2021] POST /compute/v2.1/servers => generated 406 bytes in 2392 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 03:56:05.506406 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-df7b566b-f9f7-4276-8079-85c8ac40dbe5 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:56:05.507033 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-df7b566b-f9f7-4276-8079-85c8ac40dbe5 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: ea6a4f71-9eac-42b4-bba2-a81456c3d2a4] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:56:05.735306 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-df7b566b-f9f7-4276-8079-85c8ac40dbe5 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fba01f5f17648a7a1fd0fbefd56e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6a582a2a304a7d881efcfa2373dfb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:56:05.743581 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-df7b566b-f9f7-4276-8079-85c8ac40dbe5 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/ea6a4f71-9eac-42b4-bba2-a81456c3d2a4" status: 200 len: 1093 microversion: 2.1 time: 0.241153 May 27 03:56:05.744053 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 687/1449] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:56:05 2021] GET /compute/v2.1/servers/ea6a4f71-9eac-42b4-bba2-a81456c3d2a4 => generated 1093 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:56:06.760327 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-8c1e3d35-92aa-479b-be1a-beb48b32397f tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:56:06.760972 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-8c1e3d35-92aa-479b-be1a-beb48b32397f tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: ea6a4f71-9eac-42b4-bba2-a81456c3d2a4] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:56:06.768863 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8c1e3d35-92aa-479b-be1a-beb48b32397f tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:56:06.769326 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8c1e3d35-92aa-479b-be1a-beb48b32397f tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:56:06.770102 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8c1e3d35-92aa-479b-be1a-beb48b32397f tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:56:06.770543 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-8c1e3d35-92aa-479b-be1a-beb48b32397f tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:56:06.930416 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-8c1e3d35-92aa-479b-be1a-beb48b32397f tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fba01f5f17648a7a1fd0fbefd56e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6a582a2a304a7d881efcfa2373dfb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:56:06.938580 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-8c1e3d35-92aa-479b-be1a-beb48b32397f tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/ea6a4f71-9eac-42b4-bba2-a81456c3d2a4" status: 200 len: 1135 microversion: 2.1 time: 0.181748 May 27 03:56:06.939154 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 763/1450] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:56:06 2021] GET /compute/v2.1/servers/ea6a4f71-9eac-42b4-bba2-a81456c3d2a4 => generated 1135 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:56:07.955209 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-18a44652-6960-4885-8baa-56fb6f5f202b tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:56:07.955994 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-18a44652-6960-4885-8baa-56fb6f5f202b tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: ea6a4f71-9eac-42b4-bba2-a81456c3d2a4] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:56:07.963288 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-18a44652-6960-4885-8baa-56fb6f5f202b tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:56:07.963822 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-18a44652-6960-4885-8baa-56fb6f5f202b tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:56:07.964727 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-18a44652-6960-4885-8baa-56fb6f5f202b tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:56:07.965171 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-18a44652-6960-4885-8baa-56fb6f5f202b tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:56:08.091997 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-18a44652-6960-4885-8baa-56fb6f5f202b tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fba01f5f17648a7a1fd0fbefd56e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6a582a2a304a7d881efcfa2373dfb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:56:08.100855 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-18a44652-6960-4885-8baa-56fb6f5f202b tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/ea6a4f71-9eac-42b4-bba2-a81456c3d2a4" status: 200 len: 1209 microversion: 2.1 time: 0.149266 May 27 03:56:08.101419 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 688/1451] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:56:07 2021] GET /compute/v2.1/servers/ea6a4f71-9eac-42b4-bba2-a81456c3d2a4 => generated 1209 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:56:09.117131 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-54fb327d-00a1-4f69-a678-3c24b8a798dc tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:56:09.117744 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-54fb327d-00a1-4f69-a678-3c24b8a798dc tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: ea6a4f71-9eac-42b4-bba2-a81456c3d2a4] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:56:09.124958 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-54fb327d-00a1-4f69-a678-3c24b8a798dc tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:56:09.125406 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-54fb327d-00a1-4f69-a678-3c24b8a798dc tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:56:09.126844 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-54fb327d-00a1-4f69-a678-3c24b8a798dc tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:56:09.127638 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-54fb327d-00a1-4f69-a678-3c24b8a798dc tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:56:09.331503 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-54fb327d-00a1-4f69-a678-3c24b8a798dc tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fba01f5f17648a7a1fd0fbefd56e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6a582a2a304a7d881efcfa2373dfb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:56:09.340338 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-54fb327d-00a1-4f69-a678-3c24b8a798dc tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/ea6a4f71-9eac-42b4-bba2-a81456c3d2a4" status: 200 len: 1277 microversion: 2.1 time: 0.226860 May 27 03:56:09.350099 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 764/1452] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:56:09 2021] GET /compute/v2.1/servers/ea6a4f71-9eac-42b4-bba2-a81456c3d2a4 => generated 1277 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:56:09.841181 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [req-efe9ee5b-5031-43b9-bffd-6393a2ddb083 req-829087ff-a97c-4f83-995a-be9be8699aaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea6a4f71-9eac-42b4-bba2-a81456c3d2a4", "tag": "91aa15b2-7be2-4c92-819b-1666c07ffc93"}]} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:56:09.843292 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:56:09.843292 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: warnings.warn(msg) May 27 03:56:09.852692 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-efe9ee5b-5031-43b9-bffd-6393a2ddb083 req-829087ff-a97c-4f83-995a-be9be8699aaf service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:56:09.853379 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-efe9ee5b-5031-43b9-bffd-6393a2ddb083 req-829087ff-a97c-4f83-995a-be9be8699aaf service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:56:09.870312 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.compute.server_external_events [req-efe9ee5b-5031-43b9-bffd-6393a2ddb083 req-829087ff-a97c-4f83-995a-be9be8699aaf service nova] Creating event network-changed:91aa15b2-7be2-4c92-819b-1666c07ffc93 for instance ea6a4f71-9eac-42b4-bba2-a81456c3d2a4 on hv-cinder-79326 May 27 03:56:09.875392 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [req-efe9ee5b-5031-43b9-bffd-6393a2ddb083 req-829087ff-a97c-4f83-995a-be9be8699aaf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039356 May 27 03:56:09.876365 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 689/1453] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:56:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:56:10.356103 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-e9cbf5cb-2b8c-4650-ab67-681c7021c05e tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:56:10.356738 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-e9cbf5cb-2b8c-4650-ab67-681c7021c05e tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: ea6a4f71-9eac-42b4-bba2-a81456c3d2a4] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:56:10.363785 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e9cbf5cb-2b8c-4650-ab67-681c7021c05e tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:56:10.364231 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e9cbf5cb-2b8c-4650-ab67-681c7021c05e tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:56:10.365032 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e9cbf5cb-2b8c-4650-ab67-681c7021c05e tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:56:10.365469 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e9cbf5cb-2b8c-4650-ab67-681c7021c05e tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:56:10.568084 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-e9cbf5cb-2b8c-4650-ab67-681c7021c05e tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fba01f5f17648a7a1fd0fbefd56e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6a582a2a304a7d881efcfa2373dfb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:56:10.576658 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-e9cbf5cb-2b8c-4650-ab67-681c7021c05e tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/ea6a4f71-9eac-42b4-bba2-a81456c3d2a4" status: 200 len: 1265 microversion: 2.1 time: 0.223993 May 27 03:56:10.584352 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 765/1454] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:56:10 2021] GET /compute/v2.1/servers/ea6a4f71-9eac-42b4-bba2-a81456c3d2a4 => generated 1265 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:56:11.593161 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-af646022-37ba-4daf-8c6f-9671e0515235 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:56:11.593825 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-af646022-37ba-4daf-8c6f-9671e0515235 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: ea6a4f71-9eac-42b4-bba2-a81456c3d2a4] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:56:11.601773 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-af646022-37ba-4daf-8c6f-9671e0515235 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:56:11.602229 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-af646022-37ba-4daf-8c6f-9671e0515235 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:56:11.603000 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-af646022-37ba-4daf-8c6f-9671e0515235 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:56:11.603444 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-af646022-37ba-4daf-8c6f-9671e0515235 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:56:11.864224 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-af646022-37ba-4daf-8c6f-9671e0515235 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fba01f5f17648a7a1fd0fbefd56e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6a582a2a304a7d881efcfa2373dfb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:56:11.872367 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-af646022-37ba-4daf-8c6f-9671e0515235 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/ea6a4f71-9eac-42b4-bba2-a81456c3d2a4" status: 200 len: 1265 microversion: 2.1 time: 0.283388 May 27 03:56:11.872966 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 690/1455] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:56:11 2021] GET /compute/v2.1/servers/ea6a4f71-9eac-42b4-bba2-a81456c3d2a4 => generated 1265 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:56:12.888878 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-0b991cd1-07d7-4e3e-bb06-acfda0cc1222 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:56:12.889499 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-0b991cd1-07d7-4e3e-bb06-acfda0cc1222 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: ea6a4f71-9eac-42b4-bba2-a81456c3d2a4] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:56:12.897786 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0b991cd1-07d7-4e3e-bb06-acfda0cc1222 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:56:12.898248 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0b991cd1-07d7-4e3e-bb06-acfda0cc1222 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:56:12.899024 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0b991cd1-07d7-4e3e-bb06-acfda0cc1222 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:56:12.899469 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0b991cd1-07d7-4e3e-bb06-acfda0cc1222 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:56:13.099506 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-0b991cd1-07d7-4e3e-bb06-acfda0cc1222 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fba01f5f17648a7a1fd0fbefd56e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6a582a2a304a7d881efcfa2373dfb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:56:13.107679 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-0b991cd1-07d7-4e3e-bb06-acfda0cc1222 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/ea6a4f71-9eac-42b4-bba2-a81456c3d2a4" status: 200 len: 1265 microversion: 2.1 time: 0.222729 May 27 03:56:13.108236 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 766/1456] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:56:12 2021] GET /compute/v2.1/servers/ea6a4f71-9eac-42b4-bba2-a81456c3d2a4 => generated 1265 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:56:14.124052 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-dea09d69-e76e-4129-9cbc-969f53d4d79f tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:56:14.124768 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-dea09d69-e76e-4129-9cbc-969f53d4d79f tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: ea6a4f71-9eac-42b4-bba2-a81456c3d2a4] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:56:14.132183 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-dea09d69-e76e-4129-9cbc-969f53d4d79f tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:56:14.132667 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-dea09d69-e76e-4129-9cbc-969f53d4d79f tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:56:14.133437 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-dea09d69-e76e-4129-9cbc-969f53d4d79f tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:56:14.133876 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-dea09d69-e76e-4129-9cbc-969f53d4d79f tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:56:14.325348 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-dea09d69-e76e-4129-9cbc-969f53d4d79f tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fba01f5f17648a7a1fd0fbefd56e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6a582a2a304a7d881efcfa2373dfb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:56:14.333887 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-dea09d69-e76e-4129-9cbc-969f53d4d79f tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/ea6a4f71-9eac-42b4-bba2-a81456c3d2a4" status: 200 len: 1265 microversion: 2.1 time: 0.213546 May 27 03:56:14.334440 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 691/1457] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:56:14 2021] GET /compute/v2.1/servers/ea6a4f71-9eac-42b4-bba2-a81456c3d2a4 => generated 1265 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:56:15.350737 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-e0815c28-7fd0-4cdd-aa18-0fef4e6f4da5 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:56:15.351261 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-e0815c28-7fd0-4cdd-aa18-0fef4e6f4da5 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: ea6a4f71-9eac-42b4-bba2-a81456c3d2a4] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:56:15.358378 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e0815c28-7fd0-4cdd-aa18-0fef4e6f4da5 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:56:15.358826 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e0815c28-7fd0-4cdd-aa18-0fef4e6f4da5 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:56:15.359593 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e0815c28-7fd0-4cdd-aa18-0fef4e6f4da5 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:56:15.360152 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-e0815c28-7fd0-4cdd-aa18-0fef4e6f4da5 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:56:15.562710 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-e0815c28-7fd0-4cdd-aa18-0fef4e6f4da5 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fba01f5f17648a7a1fd0fbefd56e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6a582a2a304a7d881efcfa2373dfb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:56:15.571283 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-e0815c28-7fd0-4cdd-aa18-0fef4e6f4da5 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/ea6a4f71-9eac-42b4-bba2-a81456c3d2a4" status: 200 len: 1265 microversion: 2.1 time: 0.224302 May 27 03:56:15.571850 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 767/1458] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:56:15 2021] GET /compute/v2.1/servers/ea6a4f71-9eac-42b4-bba2-a81456c3d2a4 => generated 1265 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:56:16.588453 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-c2a7f4b3-60dd-4199-bd02-f954748b1cb6 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:56:16.589139 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-c2a7f4b3-60dd-4199-bd02-f954748b1cb6 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: ea6a4f71-9eac-42b4-bba2-a81456c3d2a4] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:56:16.597053 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c2a7f4b3-60dd-4199-bd02-f954748b1cb6 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:56:16.597505 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c2a7f4b3-60dd-4199-bd02-f954748b1cb6 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:56:16.598274 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c2a7f4b3-60dd-4199-bd02-f954748b1cb6 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:56:16.598716 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-c2a7f4b3-60dd-4199-bd02-f954748b1cb6 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:56:16.786883 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-c2a7f4b3-60dd-4199-bd02-f954748b1cb6 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fba01f5f17648a7a1fd0fbefd56e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6a582a2a304a7d881efcfa2373dfb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:56:16.794977 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-c2a7f4b3-60dd-4199-bd02-f954748b1cb6 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/ea6a4f71-9eac-42b4-bba2-a81456c3d2a4" status: 200 len: 1265 microversion: 2.1 time: 0.210422 May 27 03:56:16.795609 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 692/1459] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:56:16 2021] GET /compute/v2.1/servers/ea6a4f71-9eac-42b4-bba2-a81456c3d2a4 => generated 1265 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:56:17.811380 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-dd56a249-818c-4cd2-a8c3-25b3135da41e tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:56:17.812005 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-dd56a249-818c-4cd2-a8c3-25b3135da41e tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: ea6a4f71-9eac-42b4-bba2-a81456c3d2a4] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:56:17.819381 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-dd56a249-818c-4cd2-a8c3-25b3135da41e tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:56:17.819841 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-dd56a249-818c-4cd2-a8c3-25b3135da41e tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:56:17.820652 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-dd56a249-818c-4cd2-a8c3-25b3135da41e tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:56:17.821096 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-dd56a249-818c-4cd2-a8c3-25b3135da41e tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:56:18.018002 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-dd56a249-818c-4cd2-a8c3-25b3135da41e tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fba01f5f17648a7a1fd0fbefd56e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6a582a2a304a7d881efcfa2373dfb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:56:18.026481 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-dd56a249-818c-4cd2-a8c3-25b3135da41e tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/ea6a4f71-9eac-42b4-bba2-a81456c3d2a4" status: 200 len: 1265 microversion: 2.1 time: 0.218835 May 27 03:56:18.027045 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 768/1460] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:56:17 2021] GET /compute/v2.1/servers/ea6a4f71-9eac-42b4-bba2-a81456c3d2a4 => generated 1265 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:56:19.042903 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-b0f29c61-7e1b-428d-93fd-be1866c53a33 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:56:19.043524 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-b0f29c61-7e1b-428d-93fd-be1866c53a33 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: ea6a4f71-9eac-42b4-bba2-a81456c3d2a4] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:56:19.050712 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b0f29c61-7e1b-428d-93fd-be1866c53a33 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:56:19.051166 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b0f29c61-7e1b-428d-93fd-be1866c53a33 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:56:19.051935 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b0f29c61-7e1b-428d-93fd-be1866c53a33 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:56:19.052376 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-b0f29c61-7e1b-428d-93fd-be1866c53a33 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:56:19.248319 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-b0f29c61-7e1b-428d-93fd-be1866c53a33 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fba01f5f17648a7a1fd0fbefd56e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6a582a2a304a7d881efcfa2373dfb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:56:19.257074 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-b0f29c61-7e1b-428d-93fd-be1866c53a33 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/ea6a4f71-9eac-42b4-bba2-a81456c3d2a4" status: 200 len: 1265 microversion: 2.1 time: 0.217901 May 27 03:56:19.257632 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 693/1461] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:56:19 2021] GET /compute/v2.1/servers/ea6a4f71-9eac-42b4-bba2-a81456c3d2a4 => generated 1265 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:56:20.273840 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-a4054c47-d78c-4748-b1e4-15f9c4e838a3 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:56:20.274457 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-a4054c47-d78c-4748-b1e4-15f9c4e838a3 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: ea6a4f71-9eac-42b4-bba2-a81456c3d2a4] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:56:20.281663 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a4054c47-d78c-4748-b1e4-15f9c4e838a3 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:56:20.282114 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a4054c47-d78c-4748-b1e4-15f9c4e838a3 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:56:20.283459 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a4054c47-d78c-4748-b1e4-15f9c4e838a3 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:56:20.283896 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a4054c47-d78c-4748-b1e4-15f9c4e838a3 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:56:20.475486 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-a4054c47-d78c-4748-b1e4-15f9c4e838a3 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fba01f5f17648a7a1fd0fbefd56e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6a582a2a304a7d881efcfa2373dfb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:56:20.483560 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-a4054c47-d78c-4748-b1e4-15f9c4e838a3 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/ea6a4f71-9eac-42b4-bba2-a81456c3d2a4" status: 200 len: 1265 microversion: 2.1 time: 0.213466 May 27 03:56:20.484119 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 769/1462] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:56:20 2021] GET /compute/v2.1/servers/ea6a4f71-9eac-42b4-bba2-a81456c3d2a4 => generated 1265 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:56:21.499730 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-932107c5-1cba-451d-b0c1-647c400b1c17 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:56:21.500350 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-932107c5-1cba-451d-b0c1-647c400b1c17 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: ea6a4f71-9eac-42b4-bba2-a81456c3d2a4] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:56:21.507592 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-932107c5-1cba-451d-b0c1-647c400b1c17 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:56:21.508047 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-932107c5-1cba-451d-b0c1-647c400b1c17 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:56:21.508844 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-932107c5-1cba-451d-b0c1-647c400b1c17 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:56:21.509285 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-932107c5-1cba-451d-b0c1-647c400b1c17 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:56:21.700744 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-932107c5-1cba-451d-b0c1-647c400b1c17 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fba01f5f17648a7a1fd0fbefd56e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6a582a2a304a7d881efcfa2373dfb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:56:21.708801 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-932107c5-1cba-451d-b0c1-647c400b1c17 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/ea6a4f71-9eac-42b4-bba2-a81456c3d2a4" status: 200 len: 1265 microversion: 2.1 time: 0.212776 May 27 03:56:21.709354 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 694/1463] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:56:21 2021] GET /compute/v2.1/servers/ea6a4f71-9eac-42b4-bba2-a81456c3d2a4 => generated 1265 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:56:22.725223 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-f242d5e3-d661-4395-95a3-cce29f4de5c8 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:56:22.725943 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-f242d5e3-d661-4395-95a3-cce29f4de5c8 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: ea6a4f71-9eac-42b4-bba2-a81456c3d2a4] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:56:22.733430 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f242d5e3-d661-4395-95a3-cce29f4de5c8 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:56:22.733875 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f242d5e3-d661-4395-95a3-cce29f4de5c8 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:56:22.734712 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f242d5e3-d661-4395-95a3-cce29f4de5c8 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:56:22.735147 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f242d5e3-d661-4395-95a3-cce29f4de5c8 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:56:22.936511 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-f242d5e3-d661-4395-95a3-cce29f4de5c8 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fba01f5f17648a7a1fd0fbefd56e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6a582a2a304a7d881efcfa2373dfb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:56:22.944774 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-f242d5e3-d661-4395-95a3-cce29f4de5c8 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/ea6a4f71-9eac-42b4-bba2-a81456c3d2a4" status: 200 len: 1265 microversion: 2.1 time: 0.223240 May 27 03:56:22.945333 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 770/1464] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:56:22 2021] GET /compute/v2.1/servers/ea6a4f71-9eac-42b4-bba2-a81456c3d2a4 => generated 1265 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:56:24.006910 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-0a1f0cd5-257f-4286-8dfc-88c15f2b5d48 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:56:24.007524 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-0a1f0cd5-257f-4286-8dfc-88c15f2b5d48 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: ea6a4f71-9eac-42b4-bba2-a81456c3d2a4] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:56:24.014668 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-0a1f0cd5-257f-4286-8dfc-88c15f2b5d48 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:56:24.015119 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-0a1f0cd5-257f-4286-8dfc-88c15f2b5d48 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:56:24.019937 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-0a1f0cd5-257f-4286-8dfc-88c15f2b5d48 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:56:24.019937 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-0a1f0cd5-257f-4286-8dfc-88c15f2b5d48 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:56:24.214566 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-0a1f0cd5-257f-4286-8dfc-88c15f2b5d48 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fba01f5f17648a7a1fd0fbefd56e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6a582a2a304a7d881efcfa2373dfb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:56:24.222642 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-0a1f0cd5-257f-4286-8dfc-88c15f2b5d48 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/ea6a4f71-9eac-42b4-bba2-a81456c3d2a4" status: 200 len: 1265 microversion: 2.1 time: 0.219445 May 27 03:56:24.224803 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 695/1465] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:56:24 2021] GET /compute/v2.1/servers/ea6a4f71-9eac-42b4-bba2-a81456c3d2a4 => generated 1265 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:56:25.238754 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-0b818099-7165-46ea-b7be-dc43872c2c9c tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:56:25.239380 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-0b818099-7165-46ea-b7be-dc43872c2c9c tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: ea6a4f71-9eac-42b4-bba2-a81456c3d2a4] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:56:25.246653 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0b818099-7165-46ea-b7be-dc43872c2c9c tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:56:25.247109 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0b818099-7165-46ea-b7be-dc43872c2c9c tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:56:25.247882 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0b818099-7165-46ea-b7be-dc43872c2c9c tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:56:25.248324 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-0b818099-7165-46ea-b7be-dc43872c2c9c tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:56:25.453190 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-0b818099-7165-46ea-b7be-dc43872c2c9c tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fba01f5f17648a7a1fd0fbefd56e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6a582a2a304a7d881efcfa2373dfb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:56:25.462537 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-0b818099-7165-46ea-b7be-dc43872c2c9c tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/ea6a4f71-9eac-42b4-bba2-a81456c3d2a4" status: 200 len: 1265 microversion: 2.1 time: 0.227411 May 27 03:56:25.463103 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 771/1466] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:56:25 2021] GET /compute/v2.1/servers/ea6a4f71-9eac-42b4-bba2-a81456c3d2a4 => generated 1265 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:56:26.478852 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-ea56af08-653e-4241-a06b-b33a5d013de5 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:56:26.479461 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-ea56af08-653e-4241-a06b-b33a5d013de5 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: ea6a4f71-9eac-42b4-bba2-a81456c3d2a4] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:56:26.486781 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ea56af08-653e-4241-a06b-b33a5d013de5 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:56:26.487265 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ea56af08-653e-4241-a06b-b33a5d013de5 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:56:26.488033 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ea56af08-653e-4241-a06b-b33a5d013de5 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:56:26.488486 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ea56af08-653e-4241-a06b-b33a5d013de5 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:56:26.687929 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-ea56af08-653e-4241-a06b-b33a5d013de5 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fba01f5f17648a7a1fd0fbefd56e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6a582a2a304a7d881efcfa2373dfb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:56:26.696595 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-ea56af08-653e-4241-a06b-b33a5d013de5 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/ea6a4f71-9eac-42b4-bba2-a81456c3d2a4" status: 200 len: 1265 microversion: 2.1 time: 0.221449 May 27 03:56:26.697157 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 696/1467] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:56:26 2021] GET /compute/v2.1/servers/ea6a4f71-9eac-42b4-bba2-a81456c3d2a4 => generated 1265 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:56:27.713765 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-c62bd11c-3dda-450f-9478-0028aceabbc1 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:56:27.714389 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-c62bd11c-3dda-450f-9478-0028aceabbc1 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: ea6a4f71-9eac-42b4-bba2-a81456c3d2a4] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:56:27.722239 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c62bd11c-3dda-450f-9478-0028aceabbc1 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:56:27.722697 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c62bd11c-3dda-450f-9478-0028aceabbc1 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:56:27.723469 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c62bd11c-3dda-450f-9478-0028aceabbc1 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:56:27.723914 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-c62bd11c-3dda-450f-9478-0028aceabbc1 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:56:27.807416 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 03:56:27.807653 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: Thu May 27 03:56:27 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ea6a4f71-9eac-42b4-bba2-a81456c3d2a4 (ip 10.222.0.25) !!! May 27 03:56:27.921188 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-c62bd11c-3dda-450f-9478-0028aceabbc1 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fba01f5f17648a7a1fd0fbefd56e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6a582a2a304a7d881efcfa2373dfb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:56:27.929567 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-c62bd11c-3dda-450f-9478-0028aceabbc1 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/ea6a4f71-9eac-42b4-bba2-a81456c3d2a4" status: 200 len: 1265 microversion: 2.1 time: 0.219491 May 27 03:56:27.930125 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 772/1468] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:56:27 2021] GET /compute/v2.1/servers/ea6a4f71-9eac-42b4-bba2-a81456c3d2a4 => generated 1265 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:56:28.946040 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-bc4e4c40-996f-4faa-8da6-0e7120278177 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:56:28.946661 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-bc4e4c40-996f-4faa-8da6-0e7120278177 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: ea6a4f71-9eac-42b4-bba2-a81456c3d2a4] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:56:28.953931 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-bc4e4c40-996f-4faa-8da6-0e7120278177 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:56:28.954389 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-bc4e4c40-996f-4faa-8da6-0e7120278177 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:56:28.955173 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-bc4e4c40-996f-4faa-8da6-0e7120278177 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:56:28.955621 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-bc4e4c40-996f-4faa-8da6-0e7120278177 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:56:29.164123 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-bc4e4c40-996f-4faa-8da6-0e7120278177 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fba01f5f17648a7a1fd0fbefd56e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6a582a2a304a7d881efcfa2373dfb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:56:29.172241 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-bc4e4c40-996f-4faa-8da6-0e7120278177 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/ea6a4f71-9eac-42b4-bba2-a81456c3d2a4" status: 200 len: 1265 microversion: 2.1 time: 0.229993 May 27 03:56:29.173372 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 697/1469] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:56:28 2021] GET /compute/v2.1/servers/ea6a4f71-9eac-42b4-bba2-a81456c3d2a4 => generated 1265 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:56:30.189578 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-f98105ef-008d-4272-97bb-37957b414808 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:56:30.190221 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-f98105ef-008d-4272-97bb-37957b414808 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: ea6a4f71-9eac-42b4-bba2-a81456c3d2a4] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:56:30.197444 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f98105ef-008d-4272-97bb-37957b414808 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:56:30.197890 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f98105ef-008d-4272-97bb-37957b414808 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:56:30.198648 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f98105ef-008d-4272-97bb-37957b414808 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:56:30.199081 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f98105ef-008d-4272-97bb-37957b414808 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:56:30.393038 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-f98105ef-008d-4272-97bb-37957b414808 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fba01f5f17648a7a1fd0fbefd56e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6a582a2a304a7d881efcfa2373dfb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:56:30.401100 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-f98105ef-008d-4272-97bb-37957b414808 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/ea6a4f71-9eac-42b4-bba2-a81456c3d2a4" status: 200 len: 1265 microversion: 2.1 time: 0.215815 May 27 03:56:30.401662 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 773/1470] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:56:30 2021] GET /compute/v2.1/servers/ea6a4f71-9eac-42b4-bba2-a81456c3d2a4 => generated 1265 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:56:31.417371 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-7899c835-0f6b-4f3f-b701-993f06111aed tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:56:31.417931 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-7899c835-0f6b-4f3f-b701-993f06111aed tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: ea6a4f71-9eac-42b4-bba2-a81456c3d2a4] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:56:31.425225 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-7899c835-0f6b-4f3f-b701-993f06111aed tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:56:31.425680 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-7899c835-0f6b-4f3f-b701-993f06111aed tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:56:31.426446 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-7899c835-0f6b-4f3f-b701-993f06111aed tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:56:31.426888 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-7899c835-0f6b-4f3f-b701-993f06111aed tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:56:31.617770 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-7899c835-0f6b-4f3f-b701-993f06111aed tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fba01f5f17648a7a1fd0fbefd56e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6a582a2a304a7d881efcfa2373dfb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:56:31.626511 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-7899c835-0f6b-4f3f-b701-993f06111aed tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/ea6a4f71-9eac-42b4-bba2-a81456c3d2a4" status: 200 len: 1265 microversion: 2.1 time: 0.212882 May 27 03:56:31.627086 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 698/1471] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:56:31 2021] GET /compute/v2.1/servers/ea6a4f71-9eac-42b4-bba2-a81456c3d2a4 => generated 1265 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:56:32.644138 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-b81c4166-841a-42f4-bb9e-719a31979fbf tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:56:32.644836 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-b81c4166-841a-42f4-bb9e-719a31979fbf tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: ea6a4f71-9eac-42b4-bba2-a81456c3d2a4] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:56:32.652032 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b81c4166-841a-42f4-bb9e-719a31979fbf tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:56:32.652524 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b81c4166-841a-42f4-bb9e-719a31979fbf tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:56:32.653293 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b81c4166-841a-42f4-bb9e-719a31979fbf tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:56:32.653729 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-b81c4166-841a-42f4-bb9e-719a31979fbf tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:56:32.847032 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-b81c4166-841a-42f4-bb9e-719a31979fbf tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fba01f5f17648a7a1fd0fbefd56e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6a582a2a304a7d881efcfa2373dfb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:56:32.855192 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-b81c4166-841a-42f4-bb9e-719a31979fbf tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/ea6a4f71-9eac-42b4-bba2-a81456c3d2a4" status: 200 len: 1265 microversion: 2.1 time: 0.215696 May 27 03:56:32.855754 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 774/1472] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:56:32 2021] GET /compute/v2.1/servers/ea6a4f71-9eac-42b4-bba2-a81456c3d2a4 => generated 1265 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:56:33.216711 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [req-bc70f3cc-a88f-4b17-ae13-21d496524047 req-70fd63e9-e194-449e-a68d-1a51fe9b8d21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea6a4f71-9eac-42b4-bba2-a81456c3d2a4", "name": "network-vif-plugged", "status": "completed", "tag": "91aa15b2-7be2-4c92-819b-1666c07ffc93"}]} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:56:33.223331 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:56:33.223331 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: warnings.warn(msg) May 27 03:56:33.226320 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-bc70f3cc-a88f-4b17-ae13-21d496524047 req-70fd63e9-e194-449e-a68d-1a51fe9b8d21 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:56:33.226776 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-bc70f3cc-a88f-4b17-ae13-21d496524047 req-70fd63e9-e194-449e-a68d-1a51fe9b8d21 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:56:33.242898 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.compute.server_external_events [req-bc70f3cc-a88f-4b17-ae13-21d496524047 req-70fd63e9-e194-449e-a68d-1a51fe9b8d21 service nova] Creating event network-vif-plugged:91aa15b2-7be2-4c92-819b-1666c07ffc93 for instance ea6a4f71-9eac-42b4-bba2-a81456c3d2a4 on hv-cinder-79326 May 27 03:56:33.248040 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [req-bc70f3cc-a88f-4b17-ae13-21d496524047 req-70fd63e9-e194-449e-a68d-1a51fe9b8d21 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034962 May 27 03:56:33.248647 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 699/1473] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:56:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:56:33.871846 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-f310ffdc-760b-4517-a6b3-4146c3cad8f1 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:56:33.872488 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-f310ffdc-760b-4517-a6b3-4146c3cad8f1 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: ea6a4f71-9eac-42b4-bba2-a81456c3d2a4] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:56:33.879823 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f310ffdc-760b-4517-a6b3-4146c3cad8f1 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:56:33.880326 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f310ffdc-760b-4517-a6b3-4146c3cad8f1 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:56:33.881082 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f310ffdc-760b-4517-a6b3-4146c3cad8f1 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:56:33.881523 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f310ffdc-760b-4517-a6b3-4146c3cad8f1 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:56:34.076918 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-f310ffdc-760b-4517-a6b3-4146c3cad8f1 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fba01f5f17648a7a1fd0fbefd56e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6a582a2a304a7d881efcfa2373dfb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:56:34.085673 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-f310ffdc-760b-4517-a6b3-4146c3cad8f1 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/ea6a4f71-9eac-42b4-bba2-a81456c3d2a4" status: 200 len: 1265 microversion: 2.1 time: 0.217686 May 27 03:56:34.086246 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 775/1474] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:56:33 2021] GET /compute/v2.1/servers/ea6a4f71-9eac-42b4-bba2-a81456c3d2a4 => generated 1265 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:56:35.103440 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-8f11ca62-54e8-4353-97db-c9b41de0fea0 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:56:35.104121 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-8f11ca62-54e8-4353-97db-c9b41de0fea0 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: ea6a4f71-9eac-42b4-bba2-a81456c3d2a4] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:56:35.112207 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8f11ca62-54e8-4353-97db-c9b41de0fea0 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:56:35.112684 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8f11ca62-54e8-4353-97db-c9b41de0fea0 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:56:35.113451 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8f11ca62-54e8-4353-97db-c9b41de0fea0 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:56:35.113886 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-8f11ca62-54e8-4353-97db-c9b41de0fea0 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:56:35.317688 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-8f11ca62-54e8-4353-97db-c9b41de0fea0 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fba01f5f17648a7a1fd0fbefd56e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6a582a2a304a7d881efcfa2373dfb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:56:35.322802 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-8f11ca62-54e8-4353-97db-c9b41de0fea0 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/ea6a4f71-9eac-42b4-bba2-a81456c3d2a4" status: 200 len: 1451 microversion: 2.1 time: 0.223649 May 27 03:56:35.323375 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 700/1475] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:56:35 2021] GET /compute/v2.1/servers/ea6a4f71-9eac-42b4-bba2-a81456c3d2a4 => generated 1451 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:56:35.358356 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-a7982239-5724-4c18-ae7b-9e7166b87f53 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:56:35.358900 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-a7982239-5724-4c18-ae7b-9e7166b87f53 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: ea6a4f71-9eac-42b4-bba2-a81456c3d2a4] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:56:35.366045 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a7982239-5724-4c18-ae7b-9e7166b87f53 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:56:35.366490 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a7982239-5724-4c18-ae7b-9e7166b87f53 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:56:35.367244 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a7982239-5724-4c18-ae7b-9e7166b87f53 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:56:35.367675 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-a7982239-5724-4c18-ae7b-9e7166b87f53 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:56:35.561448 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-a7982239-5724-4c18-ae7b-9e7166b87f53 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fba01f5f17648a7a1fd0fbefd56e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6a582a2a304a7d881efcfa2373dfb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:56:35.569523 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-a7982239-5724-4c18-ae7b-9e7166b87f53 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/ea6a4f71-9eac-42b4-bba2-a81456c3d2a4" status: 200 len: 1451 microversion: 2.1 time: 0.214904 May 27 03:56:35.570084 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 776/1476] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:56:35 2021] GET /compute/v2.1/servers/ea6a4f71-9eac-42b4-bba2-a81456c3d2a4 => generated 1451 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:56:38.512771 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [req-d6340dc8-c08d-4c17-9653-a64e8215ec0e req-56722890-5b59-4081-987a-a27e88f1bcd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea6a4f71-9eac-42b4-bba2-a81456c3d2a4", "tag": "91aa15b2-7be2-4c92-819b-1666c07ffc93"}]} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:56:38.514318 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:56:38.514318 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: warnings.warn(msg) May 27 03:56:38.523189 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-d6340dc8-c08d-4c17-9653-a64e8215ec0e req-56722890-5b59-4081-987a-a27e88f1bcd5 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:56:38.523634 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-d6340dc8-c08d-4c17-9653-a64e8215ec0e req-56722890-5b59-4081-987a-a27e88f1bcd5 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:56:38.685121 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.compute.server_external_events [req-d6340dc8-c08d-4c17-9653-a64e8215ec0e req-56722890-5b59-4081-987a-a27e88f1bcd5 service nova] Creating event network-changed:91aa15b2-7be2-4c92-819b-1666c07ffc93 for instance ea6a4f71-9eac-42b4-bba2-a81456c3d2a4 on hv-cinder-79326 May 27 03:56:38.690450 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [req-d6340dc8-c08d-4c17-9653-a64e8215ec0e req-56722890-5b59-4081-987a-a27e88f1bcd5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.306572 May 27 03:56:38.691157 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 701/1477] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:56:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:57:47.829038 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 03:57:47.830115 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: Thu May 27 03:57:47 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 03:57:50.385485 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 03:57:50.386051 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: Thu May 27 03:57:50 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 03:58:40.079342 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-7c94e52e-4010-428c-99b2-49351f3d2040 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:58:40.079938 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-7c94e52e-4010-428c-99b2-49351f3d2040 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: ea6a4f71-9eac-42b4-bba2-a81456c3d2a4] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:58:40.080038 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [req-6526ba76-5e80-4ef5-9fce-0ac6b27ea546 req-0029bf20-6281-426f-becc-bba39c4ff25c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea6a4f71-9eac-42b4-bba2-a81456c3d2a4", "tag": "91aa15b2-7be2-4c92-819b-1666c07ffc93"}]} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:58:40.081810 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:58:40.081810 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: warnings.warn(msg) May 27 03:58:40.085008 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: ERROR oslo.messaging._drivers.impl_rabbit [-] [76781c65-3633-4e79-8ccf-55fa2808f360] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 27 03:58:40.086736 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: ERROR oslo.messaging._drivers.impl_rabbit [-] [20689b0c-35f1-46a0-8459-afcb436c4aac] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 27 03:58:40.088264 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7c94e52e-4010-428c-99b2-49351f3d2040 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:58:40.088749 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7c94e52e-4010-428c-99b2-49351f3d2040 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:58:40.089531 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7c94e52e-4010-428c-99b2-49351f3d2040 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:58:40.089968 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-7c94e52e-4010-428c-99b2-49351f3d2040 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:58:40.092235 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-6526ba76-5e80-4ef5-9fce-0ac6b27ea546 req-0029bf20-6281-426f-becc-bba39c4ff25c service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:58:40.092769 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-6526ba76-5e80-4ef5-9fce-0ac6b27ea546 req-0029bf20-6281-426f-becc-bba39c4ff25c service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:58:40.109890 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.compute.server_external_events [req-6526ba76-5e80-4ef5-9fce-0ac6b27ea546 req-0029bf20-6281-426f-becc-bba39c4ff25c service nova] Creating event network-changed:91aa15b2-7be2-4c92-819b-1666c07ffc93 for instance ea6a4f71-9eac-42b4-bba2-a81456c3d2a4 on hv-cinder-79326 May 27 03:58:40.114985 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [req-6526ba76-5e80-4ef5-9fce-0ac6b27ea546 req-0029bf20-6281-426f-becc-bba39c4ff25c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038870 May 27 03:58:40.125715 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 702/1478] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:58:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 03:58:40.156974 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-7c94e52e-4010-428c-99b2-49351f3d2040 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: ea6a4f71-9eac-42b4-bba2-a81456c3d2a4] Going to try to terminate instance {{(pid=113020) delete /opt/stack/nova/nova/compute/api.py:2539}} May 27 03:58:40.432202 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-7c94e52e-4010-428c-99b2-49351f3d2040 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ea6a4f71-9eac-42b4-bba2-a81456c3d2a4" status: 204 len: 0 microversion: 2.1 time: 0.358319 May 27 03:58:40.440943 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 777/1479] 10.222.0.25 () {58 vars in 1239 bytes} [Thu May 27 03:58:40 2021] DELETE /compute/v2.1/servers/ea6a4f71-9eac-42b4-bba2-a81456c3d2a4 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 03:58:40.442150 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-25b4443a-8af7-40ae-86ff-a69970d423dc tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:58:40.442858 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-25b4443a-8af7-40ae-86ff-a69970d423dc tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: ea6a4f71-9eac-42b4-bba2-a81456c3d2a4] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:58:40.450496 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-25b4443a-8af7-40ae-86ff-a69970d423dc tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:58:40.450955 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-25b4443a-8af7-40ae-86ff-a69970d423dc tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:58:40.451732 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-25b4443a-8af7-40ae-86ff-a69970d423dc tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:58:40.452173 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-25b4443a-8af7-40ae-86ff-a69970d423dc tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:58:40.767284 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-25b4443a-8af7-40ae-86ff-a69970d423dc tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fba01f5f17648a7a1fd0fbefd56e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6a582a2a304a7d881efcfa2373dfb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:58:40.776055 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-25b4443a-8af7-40ae-86ff-a69970d423dc tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/ea6a4f71-9eac-42b4-bba2-a81456c3d2a4" status: 200 len: 1576 microversion: 2.1 time: 0.338701 May 27 03:58:40.777332 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 703/1480] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:58:40 2021] GET /compute/v2.1/servers/ea6a4f71-9eac-42b4-bba2-a81456c3d2a4 => generated 1576 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:58:41.794666 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-3201dc3f-6339-426e-bdc2-759f0d6d775d tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:58:41.795570 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-3201dc3f-6339-426e-bdc2-759f0d6d775d tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: ea6a4f71-9eac-42b4-bba2-a81456c3d2a4] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:58:41.816521 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3201dc3f-6339-426e-bdc2-759f0d6d775d tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:58:41.816970 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3201dc3f-6339-426e-bdc2-759f0d6d775d tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:58:41.818560 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3201dc3f-6339-426e-bdc2-759f0d6d775d tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:58:41.818998 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-3201dc3f-6339-426e-bdc2-759f0d6d775d tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:58:41.852980 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO oslo.messaging._drivers.impl_rabbit [-] [76781c65-3633-4e79-8ccf-55fa2808f360] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 44470. May 27 03:58:42.073603 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-3201dc3f-6339-426e-bdc2-759f0d6d775d tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fba01f5f17648a7a1fd0fbefd56e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6a582a2a304a7d881efcfa2373dfb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:58:42.081862 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-3201dc3f-6339-426e-bdc2-759f0d6d775d tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/ea6a4f71-9eac-42b4-bba2-a81456c3d2a4" status: 200 len: 1457 microversion: 2.1 time: 0.291269 May 27 03:58:42.082436 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 778/1481] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:58:41 2021] GET /compute/v2.1/servers/ea6a4f71-9eac-42b4-bba2-a81456c3d2a4 => generated 1457 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:58:43.098863 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-ea150d5e-45bd-471f-a43c-d025cbec8734 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:58:43.099492 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-ea150d5e-45bd-471f-a43c-d025cbec8734 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: ea6a4f71-9eac-42b4-bba2-a81456c3d2a4] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:58:43.118490 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ea150d5e-45bd-471f-a43c-d025cbec8734 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:58:43.118811 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ea150d5e-45bd-471f-a43c-d025cbec8734 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:58:43.119601 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ea150d5e-45bd-471f-a43c-d025cbec8734 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:58:43.120042 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-ea150d5e-45bd-471f-a43c-d025cbec8734 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:58:43.171355 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO oslo.messaging._drivers.impl_rabbit [-] [20689b0c-35f1-46a0-8459-afcb436c4aac] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 44476. May 27 03:58:43.176832 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [req-0d333277-a171-4a2f-aaee-08c1da17c2b2 req-7917dca2-7037-4e08-ab2b-6a5aee3bcfed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea6a4f71-9eac-42b4-bba2-a81456c3d2a4", "name": "network-vif-deleted", "tag": "91aa15b2-7be2-4c92-819b-1666c07ffc93"}]} {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:58:43.176832 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:58:43.176832 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: warnings.warn(msg) May 27 03:58:43.182085 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-0d333277-a171-4a2f-aaee-08c1da17c2b2 req-7917dca2-7037-4e08-ab2b-6a5aee3bcfed service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:58:43.182537 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [req-0d333277-a171-4a2f-aaee-08c1da17c2b2 req-7917dca2-7037-4e08-ab2b-6a5aee3bcfed service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:58:43.199049 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.compute.server_external_events [req-0d333277-a171-4a2f-aaee-08c1da17c2b2 req-7917dca2-7037-4e08-ab2b-6a5aee3bcfed service nova] Creating event network-vif-deleted:91aa15b2-7be2-4c92-819b-1666c07ffc93 for instance ea6a4f71-9eac-42b4-bba2-a81456c3d2a4 on hv-cinder-79326 May 27 03:58:43.204548 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [req-0d333277-a171-4a2f-aaee-08c1da17c2b2 req-7917dca2-7037-4e08-ab2b-6a5aee3bcfed service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095054 May 27 03:58:43.206865 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 779/1482] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:58:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:58:43.318904 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-ea150d5e-45bd-471f-a43c-d025cbec8734 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fba01f5f17648a7a1fd0fbefd56e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6a582a2a304a7d881efcfa2373dfb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:58:43.327274 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-ea150d5e-45bd-471f-a43c-d025cbec8734 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/ea6a4f71-9eac-42b4-bba2-a81456c3d2a4" status: 200 len: 1389 microversion: 2.1 time: 0.232098 May 27 03:58:43.328475 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 704/1483] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:58:43 2021] GET /compute/v2.1/servers/ea6a4f71-9eac-42b4-bba2-a81456c3d2a4 => generated 1389 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:58:44.345006 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-f070bb60-bd73-4a66-9d84-25986d3559ef tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:58:44.346540 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-f070bb60-bd73-4a66-9d84-25986d3559ef tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: ea6a4f71-9eac-42b4-bba2-a81456c3d2a4] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:58:44.353591 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f070bb60-bd73-4a66-9d84-25986d3559ef tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:58:44.354048 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f070bb60-bd73-4a66-9d84-25986d3559ef tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:58:44.354820 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f070bb60-bd73-4a66-9d84-25986d3559ef tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:58:44.355260 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f070bb60-bd73-4a66-9d84-25986d3559ef tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:58:44.425629 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f070bb60-bd73-4a66-9d84-25986d3559ef tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:58:44.426084 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-f070bb60-bd73-4a66-9d84-25986d3559ef tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:58:44.426533 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.objects.instance [None req-f070bb60-bd73-4a66-9d84-25986d3559ef tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lazy-loading 'fault' on Instance uuid ea6a4f71-9eac-42b4-bba2-a81456c3d2a4 {{(pid=113020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 27 03:58:44.481740 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-f070bb60-bd73-4a66-9d84-25986d3559ef tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fba01f5f17648a7a1fd0fbefd56e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6a582a2a304a7d881efcfa2373dfb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:58:44.490435 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-f070bb60-bd73-4a66-9d84-25986d3559ef tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/ea6a4f71-9eac-42b4-bba2-a81456c3d2a4" status: 200 len: 1229 microversion: 2.1 time: 0.149518 May 27 03:58:44.490996 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 780/1484] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:58:44 2021] GET /compute/v2.1/servers/ea6a4f71-9eac-42b4-bba2-a81456c3d2a4 => generated 1229 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:58:45.507679 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-e812399f-e7c6-4592-b654-724dd64fe172 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:58:45.508287 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-e812399f-e7c6-4592-b654-724dd64fe172 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: ea6a4f71-9eac-42b4-bba2-a81456c3d2a4] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:58:45.516342 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e812399f-e7c6-4592-b654-724dd64fe172 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:58:45.516819 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e812399f-e7c6-4592-b654-724dd64fe172 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:58:45.517579 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e812399f-e7c6-4592-b654-724dd64fe172 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:58:45.518011 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-e812399f-e7c6-4592-b654-724dd64fe172 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:58:45.567263 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.wsgi [None req-e812399f-e7c6-4592-b654-724dd64fe172 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] HTTP exception thrown: Instance ea6a4f71-9eac-42b4-bba2-a81456c3d2a4 could not be found. May 27 03:58:45.567852 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-e812399f-e7c6-4592-b654-724dd64fe172 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Returning 404 to user: Instance ea6a4f71-9eac-42b4-bba2-a81456c3d2a4 could not be found. {{(pid=113021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 27 03:58:45.568684 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-e812399f-e7c6-4592-b654-724dd64fe172 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/ea6a4f71-9eac-42b4-bba2-a81456c3d2a4" status: 404 len: 111 microversion: 2.1 time: 0.064730 May 27 03:58:45.569200 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 705/1485] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:58:45 2021] GET /compute/v2.1/servers/ea6a4f71-9eac-42b4-bba2-a81456c3d2a4 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:58:49.774686 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-81da461a-3b03-42ef-b81d-61769d2ef2fe tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:58:49.775125 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-81da461a-3b03-42ef-b81d-61769d2ef2fe tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: 07cf1f8a-a1e3-4041-a5cc-8650aafb1468] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:58:49.776149 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [req-69ba6539-f4bc-4069-8a5d-81c63be5159c req-981b13c5-ad43-455d-b60a-344f0dff89f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07cf1f8a-a1e3-4041-a5cc-8650aafb1468", "tag": "72f4926f-0769-4beb-af47-64edc4895b0c"}]} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:58:49.777732 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:58:49.777732 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: warnings.warn(msg) May 27 03:58:49.782778 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-81da461a-3b03-42ef-b81d-61769d2ef2fe tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:58:49.783236 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-81da461a-3b03-42ef-b81d-61769d2ef2fe tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:58:49.784011 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-81da461a-3b03-42ef-b81d-61769d2ef2fe tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:58:49.784485 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-81da461a-3b03-42ef-b81d-61769d2ef2fe tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:58:49.786149 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-69ba6539-f4bc-4069-8a5d-81c63be5159c req-981b13c5-ad43-455d-b60a-344f0dff89f4 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:58:49.786596 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-69ba6539-f4bc-4069-8a5d-81c63be5159c req-981b13c5-ad43-455d-b60a-344f0dff89f4 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:58:49.802113 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.compute.server_external_events [req-69ba6539-f4bc-4069-8a5d-81c63be5159c req-981b13c5-ad43-455d-b60a-344f0dff89f4 service nova] Creating event network-changed:72f4926f-0769-4beb-af47-64edc4895b0c for instance 07cf1f8a-a1e3-4041-a5cc-8650aafb1468 on hv-cinder-79326 May 27 03:58:49.807009 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [req-69ba6539-f4bc-4069-8a5d-81c63be5159c req-981b13c5-ad43-455d-b60a-344f0dff89f4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034328 May 27 03:58:49.809397 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 706/1486] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:58:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:58:49.847150 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-81da461a-3b03-42ef-b81d-61769d2ef2fe tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: 07cf1f8a-a1e3-4041-a5cc-8650aafb1468] Going to try to terminate instance {{(pid=113020) delete /opt/stack/nova/nova/compute/api.py:2539}} May 27 03:58:50.113285 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-81da461a-3b03-42ef-b81d-61769d2ef2fe tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "DELETE /compute/v2.1/servers/07cf1f8a-a1e3-4041-a5cc-8650aafb1468" status: 204 len: 0 microversion: 2.1 time: 0.342268 May 27 03:58:50.117193 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 781/1487] 10.222.0.25 () {58 vars in 1239 bytes} [Thu May 27 03:58:49 2021] DELETE /compute/v2.1/servers/07cf1f8a-a1e3-4041-a5cc-8650aafb1468 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 03:58:50.122730 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-cec2e465-7e7d-4a37-be01-c8866457faff tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:58:50.123434 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-cec2e465-7e7d-4a37-be01-c8866457faff tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: 07cf1f8a-a1e3-4041-a5cc-8650aafb1468] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:58:50.132913 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-cec2e465-7e7d-4a37-be01-c8866457faff tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:58:50.133360 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-cec2e465-7e7d-4a37-be01-c8866457faff tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:58:50.134338 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-cec2e465-7e7d-4a37-be01-c8866457faff tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:58:50.135020 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-cec2e465-7e7d-4a37-be01-c8866457faff tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:58:50.620526 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.policy [None req-cec2e465-7e7d-4a37-be01-c8866457faff tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fba01f5f17648a7a1fd0fbefd56e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6a582a2a304a7d881efcfa2373dfb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113021) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:58:50.629486 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-cec2e465-7e7d-4a37-be01-c8866457faff tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/07cf1f8a-a1e3-4041-a5cc-8650aafb1468" status: 200 len: 1578 microversion: 2.1 time: 0.510826 May 27 03:58:50.630257 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 707/1488] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:58:50 2021] GET /compute/v2.1/servers/07cf1f8a-a1e3-4041-a5cc-8650aafb1468 => generated 1578 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 03:58:51.646671 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-fe727745-e68a-444e-b592-23eb56360d60 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:58:51.647377 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-fe727745-e68a-444e-b592-23eb56360d60 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: 07cf1f8a-a1e3-4041-a5cc-8650aafb1468] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:58:51.654646 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-fe727745-e68a-444e-b592-23eb56360d60 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:58:51.655099 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-fe727745-e68a-444e-b592-23eb56360d60 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:58:51.655875 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-fe727745-e68a-444e-b592-23eb56360d60 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:58:51.656313 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-fe727745-e68a-444e-b592-23eb56360d60 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:58:51.774358 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-fe727745-e68a-444e-b592-23eb56360d60 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fba01f5f17648a7a1fd0fbefd56e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6a582a2a304a7d881efcfa2373dfb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:58:51.782688 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-fe727745-e68a-444e-b592-23eb56360d60 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/07cf1f8a-a1e3-4041-a5cc-8650aafb1468" status: 200 len: 1391 microversion: 2.1 time: 0.140131 May 27 03:58:51.783186 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 782/1489] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:58:51 2021] GET /compute/v2.1/servers/07cf1f8a-a1e3-4041-a5cc-8650aafb1468 => generated 1391 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:58:51.821546 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [req-a7dfae33-85a6-486b-ba83-8e139644f7f7 req-f35dba61-7e51-470e-aa5b-a1a038bef804 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07cf1f8a-a1e3-4041-a5cc-8650aafb1468", "name": "network-vif-deleted", "tag": "72f4926f-0769-4beb-af47-64edc4895b0c"}]} {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 03:58:51.823215 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:58:51.823215 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: warnings.warn(msg) May 27 03:58:51.831777 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-a7dfae33-85a6-486b-ba83-8e139644f7f7 req-f35dba61-7e51-470e-aa5b-a1a038bef804 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:58:51.832217 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [req-a7dfae33-85a6-486b-ba83-8e139644f7f7 req-f35dba61-7e51-470e-aa5b-a1a038bef804 service nova] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:58:51.847751 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.compute.server_external_events [req-a7dfae33-85a6-486b-ba83-8e139644f7f7 req-f35dba61-7e51-470e-aa5b-a1a038bef804 service nova] Creating event network-vif-deleted:72f4926f-0769-4beb-af47-64edc4895b0c for instance 07cf1f8a-a1e3-4041-a5cc-8650aafb1468 on hv-cinder-79326 May 27 03:58:51.852696 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [req-a7dfae33-85a6-486b-ba83-8e139644f7f7 req-f35dba61-7e51-470e-aa5b-a1a038bef804 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034805 May 27 03:58:51.853434 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 708/1490] 10.222.0.25 () {64 vars in 1318 bytes} [Thu May 27 03:58:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 03:58:52.799034 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-181c85ad-3b97-46d7-93c6-ef709182e24a tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:58:52.799747 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-181c85ad-3b97-46d7-93c6-ef709182e24a tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: 07cf1f8a-a1e3-4041-a5cc-8650aafb1468] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:58:52.806998 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-181c85ad-3b97-46d7-93c6-ef709182e24a tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:58:52.807449 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-181c85ad-3b97-46d7-93c6-ef709182e24a tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:58:52.808215 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-181c85ad-3b97-46d7-93c6-ef709182e24a tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:58:52.808682 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-181c85ad-3b97-46d7-93c6-ef709182e24a tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:58:52.875828 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-181c85ad-3b97-46d7-93c6-ef709182e24a tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:58:52.876280 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-181c85ad-3b97-46d7-93c6-ef709182e24a tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:58:52.876825 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.objects.instance [None req-181c85ad-3b97-46d7-93c6-ef709182e24a tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lazy-loading 'fault' on Instance uuid 07cf1f8a-a1e3-4041-a5cc-8650aafb1468 {{(pid=113020) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 27 03:58:52.932224 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.policy [None req-181c85ad-3b97-46d7-93c6-ef709182e24a tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fba01f5f17648a7a1fd0fbefd56e046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6a582a2a304a7d881efcfa2373dfb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=113020) authorize /opt/stack/nova/nova/policy.py:199}} May 27 03:58:52.940279 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-181c85ad-3b97-46d7-93c6-ef709182e24a tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/07cf1f8a-a1e3-4041-a5cc-8650aafb1468" status: 200 len: 1184 microversion: 2.1 time: 0.145001 May 27 03:58:52.940874 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 783/1491] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:58:52 2021] GET /compute/v2.1/servers/07cf1f8a-a1e3-4041-a5cc-8650aafb1468 => generated 1184 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 03:58:53.957613 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-9d10f289-055a-43ff-a7ea-1f57fa45a3b6 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:58:53.958247 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-9d10f289-055a-43ff-a7ea-1f57fa45a3b6 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: 07cf1f8a-a1e3-4041-a5cc-8650aafb1468] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:58:53.965758 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-9d10f289-055a-43ff-a7ea-1f57fa45a3b6 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:58:53.966208 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-9d10f289-055a-43ff-a7ea-1f57fa45a3b6 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:58:53.966976 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-9d10f289-055a-43ff-a7ea-1f57fa45a3b6 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:58:53.967410 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-9d10f289-055a-43ff-a7ea-1f57fa45a3b6 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:58:54.017900 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.wsgi [None req-9d10f289-055a-43ff-a7ea-1f57fa45a3b6 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] HTTP exception thrown: Instance 07cf1f8a-a1e3-4041-a5cc-8650aafb1468 could not be found. May 27 03:58:54.018492 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-9d10f289-055a-43ff-a7ea-1f57fa45a3b6 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Returning 404 to user: Instance 07cf1f8a-a1e3-4041-a5cc-8650aafb1468 could not be found. {{(pid=113021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 27 03:58:54.019318 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-9d10f289-055a-43ff-a7ea-1f57fa45a3b6 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/07cf1f8a-a1e3-4041-a5cc-8650aafb1468" status: 404 len: 111 microversion: 2.1 time: 0.065954 May 27 03:58:54.019866 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 709/1492] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:58:53 2021] GET /compute/v2.1/servers/07cf1f8a-a1e3-4041-a5cc-8650aafb1468 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:58:54.938144 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-20b442a2-a5c4-4400-9e20-f32a1d0bce3d tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:58:54.938652 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.compute.api [None req-20b442a2-a5c4-4400-9e20-f32a1d0bce3d tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: 8f32a2a3-7d2a-4396-8a34-0ebe6dda5782] Fetching instance by UUID {{(pid=113020) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:58:54.945889 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-20b442a2-a5c4-4400-9e20-f32a1d0bce3d tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:58:54.946349 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-20b442a2-a5c4-4400-9e20-f32a1d0bce3d tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:58:54.947121 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-20b442a2-a5c4-4400-9e20-f32a1d0bce3d tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:58:54.947568 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG oslo_concurrency.lockutils [None req-20b442a2-a5c4-4400-9e20-f32a1d0bce3d tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113020) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:58:54.997345 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.wsgi [None req-20b442a2-a5c4-4400-9e20-f32a1d0bce3d tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] HTTP exception thrown: Instance 8f32a2a3-7d2a-4396-8a34-0ebe6dda5782 could not be found. May 27 03:58:54.997952 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-20b442a2-a5c4-4400-9e20-f32a1d0bce3d tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Returning 404 to user: Instance 8f32a2a3-7d2a-4396-8a34-0ebe6dda5782 could not be found. {{(pid=113020) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 27 03:58:54.998796 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-20b442a2-a5c4-4400-9e20-f32a1d0bce3d tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8f32a2a3-7d2a-4396-8a34-0ebe6dda5782" status: 404 len: 111 microversion: 2.1 time: 0.065107 May 27 03:58:54.999952 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 784/1493] 10.222.0.25 () {58 vars in 1239 bytes} [Thu May 27 03:58:54 2021] DELETE /compute/v2.1/servers/8f32a2a3-7d2a-4396-8a34-0ebe6dda5782 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:58:55.007965 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-52994892-5eb5-499b-8925-15d842b92fd6 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '>' {{(pid=113021) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:58:55.008624 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.compute.api [None req-52994892-5eb5-499b-8925-15d842b92fd6 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] [instance: 8f32a2a3-7d2a-4396-8a34-0ebe6dda5782] Fetching instance by UUID {{(pid=113021) get /opt/stack/nova/nova/compute/api.py:2790}} May 27 03:58:55.016274 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-52994892-5eb5-499b-8925-15d842b92fd6 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:58:55.016762 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-52994892-5eb5-499b-8925-15d842b92fd6 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:58:55.017621 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-52994892-5eb5-499b-8925-15d842b92fd6 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 27 03:58:55.017989 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG oslo_concurrency.lockutils [None req-52994892-5eb5-499b-8925-15d842b92fd6 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Lock "62df2d79-0f3c-4e85-ac9f-a1fbcca38810" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113021) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 27 03:58:55.069281 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.wsgi [None req-52994892-5eb5-499b-8925-15d842b92fd6 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] HTTP exception thrown: Instance 8f32a2a3-7d2a-4396-8a34-0ebe6dda5782 could not be found. May 27 03:58:55.069882 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: DEBUG nova.api.openstack.wsgi [None req-52994892-5eb5-499b-8925-15d842b92fd6 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Returning 404 to user: Instance 8f32a2a3-7d2a-4396-8a34-0ebe6dda5782 could not be found. {{(pid=113021) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 27 03:58:55.070716 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO nova.api.openstack.requestlog [None req-52994892-5eb5-499b-8925-15d842b92fd6 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "GET /compute/v2.1/servers/8f32a2a3-7d2a-4396-8a34-0ebe6dda5782" status: 404 len: 111 microversion: 2.1 time: 0.066557 May 27 03:58:55.071256 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: [pid: 113021|app: 0|req: 710/1494] 10.222.0.25 () {58 vars in 1236 bytes} [Thu May 27 03:58:55 2021] GET /compute/v2.1/servers/8f32a2a3-7d2a-4396-8a34-0ebe6dda5782 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 03:58:56.779605 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: DEBUG nova.api.openstack.wsgi [None req-8ce93acd-2bf0-4bf8-a385-1dcd402f6578 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] Calling method '.version_select at 0x7f988809da60>' {{(pid=113020) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 03:58:56.866978 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO nova.api.openstack.requestlog [None req-8ce93acd-2bf0-4bf8-a385-1dcd402f6578 tempest-TestVolumeBootPattern-749287613 tempest-TestVolumeBootPattern-749287613-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-482559929" status: 202 len: 0 microversion: 2.1 time: 0.091056 May 27 03:58:56.867557 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: [pid: 113020|app: 0|req: 785/1495] 10.222.0.25 () {58 vars in 1260 bytes} [Thu May 27 03:58:56 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-482559929 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 03:59:14.267264 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 03:59:14.267880 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: Thu May 27 03:59:14 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 04:01:10.405229 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 04:01:10.405943 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: Thu May 27 04:01:10 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 04:01:14.875913 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 04:01:14.876494 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: Thu May 27 04:01:14 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 04:01:22.785761 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 04:01:22.786359 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: Thu May 27 04:01:22 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 04:01:27.829337 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 04:01:27.829860 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: Thu May 27 04:01:27 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 04:02:34.285209 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 04:02:34.287303 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: Thu May 27 04:02:34 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 04:04:27.850274 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 04:04:27.850764 dv-cinder-793264-1-iscsi devstack@n-api.service[113020]: Thu May 27 04:04:27 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 04:04:30.424203 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 04:04:30.424790 dv-cinder-793264-1-iscsi devstack@n-api.service[113021]: Thu May 27 04:04:30 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!